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ABSTEACT 

Financed with ESEA Title III funds since 19 
School Information System (SIS) was designed essentially to 
school administrators with data aiid information with which 
better decisions- The basic means were to (1) build and imp 
data bank, (2) prepare and disseminate computerized reports 
decisionmakers — especially school principals, and (3) train 
understand and ultimately to use the reports in their manag 
schools. By the end of the third year, 96 principals of the 
in response to a survey, reported tbey understood SIS repor 
well" or "very well," while a consistent majority said they 
reports at least monthly for at least six different functio 
addition, the reports turned out to have considerable appea 
community, parent groups, central office personnel--as well 
the principals and assistant principals.. Perhaps most indie 
major part of project costs were picked up by local funds a 
Title III grant expired in April of 1973, (Pages 33-4 2, and 
Appendix C may reproduce poorly.) (Author) 
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SECTION A -GENERAL INFORMATION 



PROJECT TITLE School Management and Evaluation System 
"School Information System" 


PROJECT 45-70-010-3 

NUMBER ^ 


Applicant Agency 

The Board of Education of the 
City School District of the 
City of Cincinnati, Ohio 


Address (complete) 

Cincinnati Public Schools 
230 East Ninth Street 
Cincinnati, Ohio <i5202 
County H;?milton 


Name of Project Director 

Bernard M. Barbadora 
Joseph L. Felix 
James N. Jacobs 


Address (complete) 

230 East Ninth Street 
Cincinnati, Ohio 45202 


Telep* '^jz Number 
621-7010 Ext. 

Area Code 
513 


Superintendent 
Donald R. Waldrip 


Address (complete) 

230 East Ninth Street 
Cincinnati, Ohio 45202 


Telephone Number 
621-7010 Ext. 

Area Code 
513 


Signature/flF Superintendent ^ y/^ 


Date 
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SECTION B-SCHOOL POPULATION AND PARTICIPATION DATA 







Number of Children 




Staff 




Enrollment Data on ur Near 
the Previous October I 


Pre- 

Kinder- 
Garten 


Kirtder- 
Garten 


Grades 
1-6 


Grades 
7-12 


Adults 


Receiving 
Inservice 
Training 


! Total 


1. Total Enrollment 
of School 
Di8trict(s) 
Served by Title 
III Project 


Public 


200 


6,100 


38,600 


34,300 




79,200 


Nonpublic 


50 


350 


10,700 


16,700 




22,800 


2. Total Enrollment 
of Schools 
Served by 
Title III 
Project 


Public 




6,100 


38,600 


34,300 




79,000 


Nonpublic 














3. Persons Directly 
Participating fn 


Public 






3 


5 




250 


258 


the Title III 
Project 


Nonpublic ^^^^^H 













4. Direct and Indirect Participation of Stucients, Teachers and Counselors 





Direct Participation 


Indirect Participation 


Type of School 


Teachers 


Counselors 


Teachers 


Counselors 


Students 


Elemen- 
tary 


Secon- 
dary 


Elemen- 
tary 


Secon- 
dary 


Elemen- 
tary 


Secon- 
dary 


Elemen- 
tary 


Secon- 
dary 


Elemen- 
tary 


Secon- 
dary 


Public * 


3 


3 


2 


2 


^J,000 


1,000 


0 


0 


44,69: 


34, 2S 


Nonpublic 
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SECTION C- ETHNIC, TARGET POPULATION, AND RURAL/URBAN PARTICIPATION 



1. PARTICIPANTS REPORTED IN 
B-3. PREKINDERGARTEN 
THROUGH ADULT BY 
1 ETHNIC GROUPS 

Number of Participants 


Negro 
American 

2 


Indian 
American 


Oriental 
Amoricnii 


Spanish surnamed 
American (Mexi- 
can, Puerto Rican, 
Cuban descQnt) 


Caucasian 
6 


Other 


1 Percent of Participants 


20% 








80% 






2. PARTICIPANTS REPORTED IN 
B-3, PREKINDERGARTEN 
1 THI^OUGH ADULT BY " 
) TARGET :^PULATION 


Migrants 


Disadvantaged 


Handicapped 


Early Childhood 
Education 


Other-Specify 






Number of Participants 
















1 -3. PARTICIPANTS REPORTED ?N 
B-3. PREKINDERGARTtr? 
THROUGH ADULT BY 
RURAL/URBAN DISTRIBUTION 


Rural 


Standard Metropolitan Area 


Other Urban 


Farm 


s 

Nonfarm 


Low 
Socioeconomic 
Area 


Other 


Low 

Socioeconomic 
Area 


Other 


Percent of Total 
Number Served 






16 


84 







SECTION D- PERSONNEL FOR ADMINISTRATION AND IMPLEMENTATION OF PROJECT 



Type of Paid Personnel 


Project Staff Paid with 
Title III Funds 


Project Staff Not Paid with 
Title III Funds and Volunteers 


Pull 

run 
Time 

1 


Part Time 


run lime 
Equivalent 


hull 
Time 


Part Time! 


ruu Time 
Equivalent 


Half or 
greater 


Less than 
half 


Half or 
greater 


Less than 
half 


1. Administration/Supervision 


1.0 






2 


.50 


2. Teachers 
1 a. prekindergarten 


















' D. KinQcrgdricn 


















c. grades 1-6 


















d. grades 7-12 


















e. other 


















3. Subject matter specialists 
(Artists, scientists, etc. other 
than regular teachers) 


















4. Technicians (audiovisual, etc.) 


1 


2 




2.6 










5. Pupil personnel workers 
(Guidance, counseling, testing, 
attendance and school social work) 


















6. Health services personnel 
(Medical, dental, psych ia\Vi<^) 


















7. Researchers and evaluators 






1 


.25 










8. Planners and ^ievelopers 


















9. Disseminators (writers, 

public relation personnel, etc.) 






1 


.25 










10. Other professionals 


















11. Paraprofessionals (education 
a(des, etc.) 


















12. Other nonprofessionals 
(clerical, pupil transportation 
* Qi jrvices, etc.) 


1 




1 


1.45 
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SECTION F. - REPLICATION OF ESEA TITLE III PROJECT BY OTHER SCHOOL Dl STR I CTS 



According to ycur best information, list the name and location of school districts 
which have replicated to some degree components of the ESEA Title III project 
reported on this form. (Add additional lines if mecessary). 

NAME LOCATION 

Mr. Darwin Keye, Secondary Coordinator Mt. Healthy City Schools, 1743 Adams Ro ad, 

Mt. Healthy, Ohio 45231 



SCHOOL MANAGEMENT AND EVALUATION SYSTEM 



II. A. Summary 

This Project, funded for three years under ESEA Title III, has 
had three fundamental and largely sequential objectives: To develop 
and implement an information system on the school level, to improve 
the system, and to help educational decision-makers understand and 
ultimately use the system. The targetted audiences were, of course, 
the educational decision-makers — primarily school principals and 
secondarily central office administrators plus supervisors. Not 
surpi'isingly., many other groups and individuals turned out: to be 
served too. 

The proposal for the Project arose in the late 1960 's when 
alert District personnel started to seek relatively objective and 
varied data to support the overall decision process. This effort 
culminated in the proposal, submitted in early 1970. 

Basic procedures under each of the three aforesaid objectives 
can be listed rather simply. In developing the information system , 
the Project staff assessed the informational needs of their various 
target groups, designed a model of the eventual system, collected 
and generated data, prepared the data for analysis and output by 
computer, processed and de-bugged the resulting printouts or 
reports (on each of 100 District schools) , wrote interpretive 
memorandums to accompany and clarify the reports, and distributed 
all this to the intended audience. In improvin g the system , more 
or less all the procedures under the first objective were scru- 
tinized and replicated. Finally, in training decision-makers to 
understand and use the system, the emphasis shifted (a) initially 
to feedback from decision-makers and others on how the reports 
were being received, and (b) ultimately to a series of in-service 
programs for system users. 

Evaluation for the first objective was largely a matter of 
face validity; i.e., was the information system being developed 
as it had been proposed. Evaluating the second and third objec- 
tives, on the other hand, consisted for the most part of surveying 
the report users to see if, in fact, improvements had been made 
and if the reports were proving useful. 

Results of the various evaluations were predominantly favor- 
able. The most tangible evidence of this was the fact that the 
Cincinnati Board of Education has decided to continue the Project 
under local funds — despite exceptional tightness- in the LEA budget 
for the past five years. 
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II. B. Context Description 

By 1968, the Cincinnati Public Schools had developed a keen 
interest in building a data bank — primarily for the sake of improv- 
ing program administration evaluation. But local funding had been 
very tight for the School District throughout, the la^e 1960 's. So 
the District's Division of Program Research and Design, under the 
direction of James Jacobs, sought and gained limited financial sup- 
port through Title I of the Elementary and Secondary Education Act 
(ESEA) and through the Disadvantaged Pupils Public Fund (DPPF) for 
the State of Ohio. 

This effort culminated in the hiring of two experienced District 
people in early 1968 to start collecting elementary school data. The 
two professionals collected whatever data they learned was available, 
outside agencies were hired to prepare and process this data, and 
the resulting computer printouts were disseminated to all elementary 
principals in the Cincinnati Public Schools. 

An essential n^ed justifying this effort was identified at the 
time and has remained basically unchanged ty the present — namely, 
to provide more meaningful data to decision-makers and thereby aid 
them in their daily and long-term decision-making tasks. A second 
needy perhaps no less important, was to provide persuasive evidence 
for wha,t is done in the Cincinnati ^^ublic Schools. This need today 
is commonly referred to as accountability to the public. According 
to a late 1970 Gallup poll, '>wo of three adults nationwide favor 
increased accoirntabllity for teache'rs and school administrators. 

As the data bank became more than embryonic, the people involved 
all recognized the desirability of gaining more substantial support. 
In April of 1970, a formal proposal was submitted to Title III of 
ESEA. The proposal title was School Management and Evaluation System 
(SMES) , since ^it pointed at school- level information to help Toanage- 
ment in its decision-making and evaluation of programs — via a system 
approach. By May of 1970, word was received that the proposal was 
to be funded. 



II. C. Program Explanatior; 

Scope Of The Program 

1. Number and Kinds of Participants 

Brosdly speaking, the School Information System 
served the Cincinnati Public Schools as a whole. Mora 
specifically, there were several identifiable populations 
served in varying ways. Primary service was provided to 
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the 100 school principals in the District. Secondary 
attention was directed to the 65 assistant principals 
and the diversity of District administrators and special- 
ists on up to the superintendent — numbering around 140. 

Direct services to the above groups, typically with 
multi-school responsibilities, inevitably meant at least 
indirect service to the classroom teachers (some 3,400) 
and to the students (roughly 77 ,000) District-wide. In 
another sense, all the teachers and three entire grades 
(i.e., 6th, 9th, and 12th) of students expressed them- 
selves to the Project via the teacher and student surveys. 

A tertiary target group has been lay community 
people (of a large but indeterminate number) who have 
used SIS reports or attended project-oriented meetings* 
Promlnsnt in this group have been parents. Among several 
forms of participation, large samples of the parent popu- 
lation have taken the parent survey and thus become part 
of the Project's data bank. 

2. Specified Objectives 

As stated in the section of evaluation,, these were 
(a) development of a system's model to meet ascertained 
management needs, (b) collection of recorded data^ 
(c) generation of survey data, (d) analysis of data, 
(e) interpretation of data, (f) preparation of data 
reports, (g) report evaluation, (h) report dissemination, 
(i) training for decision-makers to understand and use 
reports, and (j) evaluation of user training. 

3. Staff Responsibilities, Qualifications, Etc. 

The staff throughout the life of the Project has 
included a manager, a programmer/analyst, a disseminator/ 
evaluator, and a secretary. In addition, for at least 
half of the three years, there has been a data collector, 
a statistical clerk, and two other programmer/analysts. 

Duties of the staff were rather well described by 
the titles given above. The project manager coordinated 
and directed the work of the entire staff; the programmer/ 
analysts developed and de-bugged report software; the 
disseminator/evaluator had a hand in most of the narrative 
products beside covering most process evaluation and some 
product evaluation; the data collector picked up data 
from a number of offices inside and outside the District; 
the statistical clerk lent able assistance to the col- 



lector; and the secretary scrambled to keep up vith the 
variety of assignments from her half --dozen "bosses/* 

How devoted to these duties were the incumbents? 
For the first project year, all staff were full-time. 
Afterward, however, the need for programmers was 
acknowledged and two programmers were added. But the 
budget for the second and third years had to be kept 
down* so only the manager and secretary remained full- 
time over the entire three years. For instance, the 
disseminator -evaluator was cut to half-time after the 
first year and the data collector' 3 time was even less. 
It might be noted here that the programmers, because 
of their rather low priority to the hardware available 
to ixhem, frequently had to work odd hours (especially 
between midnight and 8 a.m.) in order to gain respect- 
able turnaround time between computer runs. 

Something should be stated about qualification 
of the staff. The project manager had completed 
coursework for a doctorate in educational research, 
management, and evaluation at Ohio State University. 
One programmer/analyst had a background in accounting 
and business applications, while the other two had 
been trained in mathematics. The data collector drew 
from long experience in the District ^,as a teacher and 
school principal. The disseminator/evaluator was a 
former journalist and teacher before completing a 
doctorate in school administration and communications. 
The clerk and .secretary were both highly qualified for 
their positions under civil service requirements. 

All of the prof essilDnal staff has several o^cca- 
sions ^for upgrading their job skills. These occurred 
by and large in the form of outside counsultants for 
(a) the project manager; e.g., Professor Desmond Cook, 
Ohio State University, on management; Professor Edwin 
Novak, Ohio State University, on systems design; and 
Dr. Jack Bieda, Procter and Gamble, on statistics; and 
for (b) the programmer/analysts; e^g* , Dr. James 
Gunnell, Ohio State University, on surveys; and Dean 
Harry Smith, Rensselaer Polytechnic Institute, on 
statistical applications atid report formatting. The 
disseminator/evaluator, on the other hand, took advan- 
tage of several in-service seminars and workshops 
designed for District evaluators. 

Regarding staff stability, it was complete except 
for the secretary. The average tenure there was one 
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year. Fortunately^ when budgetary constraints forced 
several positions onto less than full-time, the depart- 
rrsntal home of the Project helped maintain people under 
other budgets . 

Program Procedures 

1. Time Period and Report Coverage 

The School Information System ran from May 1, 1970, 
through April 30, 1973. This report centered on the 
third year of the three-year endeavor but sought to em- 
brace essentials for all three years. 

2. Location and Arrangements 

Tt was estimated that some sixty percent of project 
procedures took place on the Third Floor of the Education 
Center for the Cincinnati Public Schools — within the 
District! s Department of Research and Development. The 
remaining forty percent was divided about equally between 
more than half the District's 100 schools and four com- 
puter installations; i.e., Hamilton County Data Proces- 
sing Center, University of Cincinnati Computer Center, 
Regional Computer Center for Hamilton County, and the 
District's own Division of Data Processing. Project 
staffers were provided two and a half rooms for offices 
and storage in the Education Center, while their accom- 
modation in the field was strictly transient. 

3. Main Services and Methods 

As stated elsewhere, the culminating service of 
SIS was to produce highly useful data reports to District 
decision-makers. In broad terms this was accomplished 
by first developing and upgrading a rather comprehensive 
information system (for the first two years) and then 
training the decision-makers to understand and use the 
system effectively (during the third year). 

It. should be made clear that project reports, the 
basic product of the Information System, feature (1) the 
statistical techniques of correlation, regression and 
factor analysis, (2) a survey component undergirded by 
pilot tests and periodic revisions of the instruments, 
massive respondent populations as totalities or as 
random samples, standardization of instructions and 
general procedures for administration, processing via 
computer, reliability testing, and a series of validity 
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checks, as well as (3) accompaniment for all ten reports 
^ by Interpretive memorandums to aid users toward thorough 
understanding of contents. Substantial documentation of 
these features was avilable in the CGA for 1972. 

Infrastructure for all the above was an automated 
data bank. This has meant, for exam^^le, that any or all 
of the several hundred thousand variables — loaded onto 
disks"can be accessed directly from teletype terminals 
at no less than eight locations around the District. 
Thus, in addition to the regular reports produced for 
all 100 schools, a system user can quickly receive a 
report tailored to his exact specifications. 

5. The Role of Lay People 

As stated elsewhere, local communities and parents 
iviterested in the public schools have made extensive use 
of project materials. Evidence of this has been more 
than a hundred school-community meetings focusing on SIS 
reports. These have been mandated district-wide at least 
once a year to inform communities about school affairs, 
while supplei^entary meetings have been scheduled at the 
discretion of individual schools. Another common mode 
of contact has been requests by phone. Dozens of these 
have been received. Related discussion is given in the 
section on dissemination. 

A very different but equally emphatic role for lay 
people has been their inclusion on four survey advisory 
committees. Three or more community representatives 
have participated on each of these. The major responsi- 
bility of the committees has been to recommend changes 
in survey content ar.d in how results are presented to 
communities. Finally, moving from depth to breadth of 
involvement, the Project has maintained a rather steady 
flow of general publicity with articles in r.stwspapers , 
District n^s letters, and SIS's own newsletter. 

6. Financial Considerations 

The total cost of the Project was $293,000 for 
three years. Of this amount ^ $267,000 or ninety-one 
percent was provided under ESEA Title III. The remain- 
ing $26,000 was a very conservative ^^jsstimate of support 
from several other sources: The Hamilton County Data 
Processing Center which gave the Project a strikingly 
low price for the use of its hardware; the Hewlett 
Packard Company which did the same with its computer 
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terminals; ESEA Title I contributed occasional time slots 
from non-project personnel; and, of course, the LEA pro- 
vided basic facilities plus, quite recently, substantial 
help processing the very large parent survey. 

The cost of continuing the Project beyond its Title 
III period — essentially at the s^me level of "production''— 
was expected to drop about twenty-five percent. This econ- 
omy was largely explained by the elimination of a program- 
mer/analyst, since the preponderance of software had been 
developed by that time. 

Major categories of cost were roundly estimated ss 
follows s computer processing (software as well as hard- 
ware) ~ $100,000; dissemination — $75,000; administra- 
tion — $50,000; and evaluation — $25,000. Like most 
projects in education, the bulk of the money went for 
professional personnel. However, with its emphasis on 
computerized reporting, the School Information System 
speiit a sizeable amount on computer usage as well as 
duplication and clerical services. The brief list below 
is given in accordance with state guidelines. ^ 

Total Federal iiupport Under ESEA Title III 
Total Federal Support Other Than Under ESEA Title III 
Total Non-Federal Support 
Total Project Cost 
Total Evaluation Cost 



$ 


267.100 


$ 


1.000 


$ 


25,000 


$ 


293.100 


$ 


25.000 
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7. Evaluation Provisions and Impact ^ 

Considerable detail in this regard hae h^eh supplied 
in the lengthy section on ev.^luation. Suffice here to men- 
tion the following. Approximately twenty percent of the 
disseminator/evaluator 's total assignment focused on evalu- 
ation while the head of project evaluation for the District 
spenu several weeks during the third year alone coordif»ating 
appraisals of the two major training programs for SIS users. 

Target population?:^ were in a sense employed as evalu- 
atora too, ^since their reaction to ^^jfoject products was sur- 
veyed on several occasions. Incidentally^ this survey effort 
not only embodied the preparation and administration of for- 
mal written instruments for there were many informal oral 
contacts between staffers and users. The project manager 
judged that more than one hour weekly on the average was 
given to this unstructUjTed activity. 

In terms of Impact, evaluation efforts as a whole were 
instrumental in several fundamental areas: (a) structuring 
and restructuring the noted tr^^ining programs, (b) modifying 
and sharpening staff assignments from year to year, and 
(c) repeatedly revising report formats f6r greater under- 
y^- standabillty and utility. 
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Effect Of Pro,1ect On Cooperating Agencies 

A number of agencies and organizations have been named in pre- 
vious sections. But only those with whom SIS has or has had a mutuel 
relationship will be included below — along with some organizations 
yet unnamed* 

A. Bureau of Educational Research, University of Virginia 
(Charlottesville): SIS has used the Bureau^s hardware 
and software for statistical work, while the Bureau has 
benefitted from our theoretical models in order to develop 
a district-level information system for the State of 
Virginia. (Second year of Project.) 

B. Center for Urban Information Systems at the University 
of Cincinnati': This organization has produced a number 
of batch processed reports and has interacted frequently 
with the staff's programmer/analysts. In fact» the 
Center has served as t^ > Project's interface with the 
University's Compute': ^nter. Moreover, the respective 
data banks of the Center and SIS have been shared rather 
extensively. (Second year of Project.) 

C. City Planning CotnmlBsiiOn of Cincinnati: This office 
provided the Project with detailed maps on the city for 
the later purpose of matching census tracts with school 
attendees vireas* Ue have provided them with data on 
juvenile arrests > dropouts, attendance, and the student 
survey. (Firat, second, and third years of Project.) 

D. Educational Development Faculty at the Ohio State 
University: This relationship has meant consultation 

on concv^ptuallzing the project in a resource allocation 
mode, asslBtance in developing the evaluation model, 
and considerable help in carrying out the "maverick" 
study which identified and analyzed over- and under- 
achieving schools* SIS, of course, provided one of 
their doctoral students with all the data to be 
analyzed. (First and second year of Project.) 

E* Data Processing Center of the Hamilton County Board 

of Education: The essence here was the financial sup- 
port given to this center in return for the very 
advantageous arrangement for C?U time. (First, sec- 
ond, and third year of Project.) 

F. Data Systems Design and Management Science Departments 
of Che Procter and Gamble Company: The company has 
released a person to serve on the Project's Committee A. 
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this systems specialist has had frequent mutually 
beneficial interactions with the programmer/analyst. 
The company h&a also offered help in drawing lay samples 
in the school district, although this offer is being 
accepted for the first time for the next parent survey, 
(Second year of Project.) 

G. Hewlett Packard: This developer of hardware and soft- 
ware packages has made its local system available to 
SIS while SIS in its turn is testing the system for its 
hardware utility. (Third year of Project.) 

H. Parent Teacher Associations: SIS has provided the PTAs 
with reports and spoken at several of their meetings. 
For this part, literally hundreds of PTA members have 
volunteered generous amounts of their time for survey 
work — especially phoning Lay respondents. (First, sec- 
ond, and third years of Project.) 

I. Local Educational Agencies: The Mt. Healthy School 
District in Cincinnati has used all of SIS*s surveys 
as well as the programming software to process the 
data. (Third year of Project.) 

J. Model Cities: Model Cities has used our instruments 
as well as our data in carrying out their evaluation 
studies. (First and second years of Project.) 

K. School Community Associations (SCA): They have used 
our t ,B as well as our survey data extensively. 
Specific uses include — planning and evaluation at the 
local elementary, junior, and senior high schools. 
(First, second, and third years of Project.) 

Organizations with whom the Project has exchanged services in 
the past but not within the last year Include the Radio Corporation 
of America and the Regional Computer Center for Cincinnati and 
Hamilton County. 



II. D. Evaluation Of Activities And Outcomes 

First, a caveat is in order regarding "the matter in whiclii all 
persons receiving treatment were chosen" and "the significant Ciharac-- 
teriscics of those participants" (from the State Department's In- 
structions). The Project's closest approximation of participants 
"receiving treatment" has been district principals — and possibly 
assistant principals, central office supervisors, directors, and top 
administrators — who received training to improve their understanding 
and use of project reports. So the items quoted above were not matters 
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of real concern for the School Information System. Indeed, the highly 
•'TiaBual thrust of the entire project made many standard evaluation 
,pi?o/i:eduro8 Inappropriate as will he seen below. 

1. Objectives (Referring notably to the third and fourth aspects 
under "Evaluation of Activities and OD^tcotnes") 

These remained almost perfectly stable over the three-year period. 
A gradually shifting personal preference of project management has led 
to slight changes in the actual wording of a few objectives . but the 
perception of the essential charge has been remarkably constant. With 
the benefit of a three-year perspective, the fundamental objectives 
have been reduced to three in number. What were formerly part of a 
longer list have been classified as sub-objectives, since they could 
be neatly subsumed. Now each of the "big three" will be considered 
more closely — with particular attention to levels of accomplishment 
and means of measurement. 

Objective I — The Development Of A School Information System 

This was the overarching charge of the project's first two 
years. So its accomplishment has been discussed with some detail 
In the first and second Applications for Continuation Grant (see, 
for example, pp. 11-37 in the 1972 Application). As review, the 
major steps of that discussion were (a) development of a system's 
model to meet identified management needs, (b) collection of recorded 
data, (c) generation of survey data, (d) analysis of data, (e) inter- 
pretation of data, (f) preparation of data reports, and (g) dissemi- 
nation of reports. K 

The technique used in measuring the accomplishment of these 
various steps was primarily face validity. In effect, was the 
information system developed? Appendix H in the 1972 CGA provided 
a reproduction of a Variable Printout, the Project's most compre- 
hensive computer-based report. The Variable Printout embodied the 
entire system rather well, because it represented collection and 
generation of several hundred variables, presentation of data in 
various forms (I.e., absolute numbers, percents, averages, and 
standard deviations), and dlssemirsation — along with interpretive 
memorandums — to all regular district schools. In fact,, at the time 
of this writing, the Project distributed no less than l:en distinct 
reports to the same 100 schools. One-page samples of each have 
been reproduced in Appendix A. 

In addition to face validity checks on the accomplishment of 
the first objective, the project staff (1) scrutinized their own 
basic procedures in data collection, (2) spot-checked data output, 
(3) pilot-tested the surveys, (4) searched the literature on data 
analysis, (5) ef'.couraged reaction from a half-dozen consultants, 
and (6) surveyed school principals — the major target group for 
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the Project. These assessment were discussed In the second CGA, 
especially on ppr 12-13, 16, 19, and 25-37. While the eivaloiative 
data gathered was not wholly complitnentary , it did ^^mount to 
unequivocal evidence that the Project had definitely developed 
a school information system with its several ramifications as 
specified by objectives one through four in the original proposal 
(see pp . 4-5) . 

Objective II — > Tmproving The System 

In broad terms, this was the fundamental charge for the <roJect*s 
second year. This is not to state that developmental work stopped or 
that user training had not started, for there was temporal overlap 
among the three areas of endeavor* 

Moreover, this second objective grew directly out of the first. 
For as development occurred, each step was soon persued for possible 
improvement. Therefore, evaluation of this objective has been partly 
covered under objective I. Efforts in this regard were elaborated in 
the second CGA. Suffice here to touch upon a few of the most important 
ones« 

Compatibility of SIS data with that from other offices became a 
major concern during the second year. In one case, SIS had been 
computing district averages by using the number of schools and not 
accounting for their varying student populations. This turned out 
to be incompatible with figures computed by the Division of Evaluation 
Services; and, since the latter figures were really better, we dropped 
ours and adopted theirs. 

As for the survey component of the data bank, a carefully chosen 
committee was put together for the primary purpose of survey improve- 
ment. One result was a painstaking revision of both the student and 
teacher surveys* As noted under Objective I, a handful of consultants 
also inputed on the surveys. 

Numerous improvements were made on the format of the various 
project reports* Potentially mysterious abbreviations were clarified, 
stanine rankings were made more flexible and realistic, most variables 
were denoted as desirable or undesirable — for more meaning and utility 
to users, and factor structures were strengthened (CGA 1972, pp, 29-30)* 
Evaluation of these changes resided for the most part in a survey of 
the school principals; results of this survey were tecounted on pp* 31- 
34. 

But probably the most noteworthy improvement had to do with 
automation and conversion. More specifically, the system*^ data bank 
was essentially automated on an IBM 360-40 by the middle of the 9econd 
year* Then, with the District's acquisition of a Hewlett Packard 2000 C 
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system early in the third year, it was decidgrd to convert the SIS bank 
accordingly. 

The programming task has. been considerable and has included pack- 
ages for correlation, regression, and factor analysis. Notwithstanding, 
since May of 1973, users in the central office and in many schools 
have enjoyed on-line access to any variable in the bank. The improve- 
ment represented by the above is substantial: (1) an in-district 
system (versus one in which the Project had always been relegated to 
squeeze-it-in, odd hours status) assures high priority consideration, 
and (2) multi-terminal access means greatly enhanced speed, visibility, 
and excitement for the Project at large. 

Objective III — Training System Users 

This objective predominated for the third and final year of the 
Project under ESEA Title III. As intimated earlier, the training 
effort was going on during the second and even the first year of SIS 
(see, for example, pp. 27-28 in the 1971 CGA) . Furthermore, the 
interpretive memorandums — an important component of the In-service 
program — had been prepared, circulated, and discussed amot^ig the 
targeted administrators since early in the second year. 

Nonetheless, the training objective moved to center stage only 
during the past year. August of 1972 was the first time that the 
principals were brought out of their daily problems and put through 
several days of intense exposure to SIS materials. Parenthetically^ 
what the Project did at that ti'ma was adopted by the Distirict*s top 
administration, as the major in-service session for school principals. 

Documentation of the program, including a Al-page evaluation 
report, is given in Appendix B. Highlights of the report are sum- 
marized below. There were eight subgoals of the overall training 
program: (1) To provide ffrinclpals an opportunity to review and 
apply 1971-72 SIS data to specific task situations. (2) To assist 
principals in acquiring a functional knowledge of SIS. (3) To 
assist principals in the use of SIS data for decision making relat- 
ing to goal setting and problerti identification. (4) '^o assist 
principals in the utilization of SIS data in program evaluation* 
(5) To assist principals in the interpretation and use of the Stu- 
dent, Teacher, and Parent Surveys. (6) To assist principals in 
communicating information to staff, students, and the public. 
(7) To provide knowledge about the nature and qualities of deci- 
sions and Information. (8) To show the relation between SIS 
reports and accountability. 

Three Instruments were used to collect evaluation information: 
Participant ratings (post only) of the program's value, a content 
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test (pre and post), ssnd a test simulation (pre and post). In 
addition, district evaluators rapped participants informally on a 
periodic basis, and a sugge£<ticn box was provided. 

While the aforesaid report offerc? considerable detail about 
the results, only major conclusions will be excerpted here* 

In general, the training program may be labelled 
a highly successful in-service effort. Eighteen of the 
tuenty-five evaluation objectives were achieved. These 
included at least one objective under each of the eight 
subgoals. The in-service proved most successful in 
achieving objectives related to goal setting, problem 
identification, and program evaluation. The areas seem- 
ing most in need of follow-up are the application of SIS 
data, functional knowledge of the system, and communica- 
ttcn techniques. 

None of the fifteen program components were rated 
so low as to dictate its being eliminated from future 
replications. Each component was rated at or above the 
midpoint of the scale by at least one of the two groups* 

The second major in-service effort for the Project occurred in 
early November, less than three months after the firftt effort. (Par- 
enthetically, this second training program was not originally sched- 
uled in project objectives but grew out of demand apparently generated 
from the training for principals.) The target population this time 
included virtually all central office administrators and supervisors. 
This program wafii about half as long as the one for principals, so 
goals were a bit less ambitious: To ascertain specf^fic needs for 
post-program training for the population, and to assess the extent 
to which these same people accept and understand the School Infor- 
mation System. 

The assessment was based on instruments essentially the saime as 
those used with the program for the principals. Since a copy of the 
entire evaluation is given in Appendix C, only a summary is provided 
here. The two-day workshcip for the central office appeared to have 
about the same measure of success enjoyed by the program for field 
administrators. 

In particular, 

— Cognitive instruments administered! before and after the work- 
shop indicate knowledge gainr among nearly all participants* 
An attitude scale used at the end of the program shoved 
highly favorable feelings in workshop-related areas* 
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— Smallest gains in mea&ured knowledge occurred in the area 
of goal setting and problem identification. Possibly be- 
cause of increased item difficulty » post-test percentages 
of correct response declined on several items In this area. 

— No single area emerges from the evaluation results as most 
important for future in-service training. Despite the 
decline in the goal setting area, these post-test percent- 
ages compared favorably with those for program evaluation, 
survey use, and functional knowledge of SIS. The approach 
of the workshop in dealing briefly with several major areas 
apparently served to supply some general deficiencies in 
the knowledge necessary to use SIS effectively. 

— Attitudes toward topics related to workshop content and 
goals appear rather uniformly positive. Items in three 
categories, SIS, Using Evaluation Data* and the Workshop 
produced consistent mean scores. Participants generally 
agreed with favorable statements and disagreed with 
unfavorable statements* 

Almost at the same time as the workshop for central office 
personnel, one of the assistant superintendents — as part of another 
study — surveyed a handful of principals as to (1) their current or 
planned use of SIS, (2) the monetary value of SIS data to them, 
(3) their interest in accessing SIS reports via computer terminal, 
and (4) teachers who have expressed interest in having a terminal 
at their school. All respondents checked "y^s" and fluctuated 

between "don't know" and $750 on //2, while a majority reacted 
positively to #3^ Only on the fourth question did the principals 
get split evenly between affirmative and negative responses. 

In the same vein as the fall workshop, three other "rump" 
sessions were generated out of rather spontaneous felt needs. 
One was held for selectecJ staff in the Division of Personnel, and 
another worked with directors in the Department of Human Resources* 
Both of the foregoing, incidentally, were quite small and empha- 
sized specific applications of SIS reports. They were not evalu- 
ated by the Project. 

The third, put on in late March, was intended for instructional 
supervisors. The project evaluator would like to take just a few 
words to compliment the project manager on the reception given his 
presentation, .ftll nineteen participants reported they were 
"motivated" by the session, and all but one checked "good" (versus 
*'fair" or "poor") as theiv overall assessment. A copy of materials 
used as well as the appraisal instrument is given in Appendix D. 

The final focus of evaluation for the third year's major 

ERLC 



20 



objective (again, training SIS users to understand and use SIS pro- 
ducts) was a late April survey of all the principals. This survey 
of the principals was deemed of major importance in terms of its 
focus and its timing. The focus, of course, was the target group 
acknowledged as paramount. The timing was equally significant 
since it came after all essential efforts had been carried out. 
All other assesstnents preceded sizeable segments of the Project 
under Title III. 

First, a few words about survey response. After two follow- 
up contacts, 96 of the 98 principals (two covering two schools 
apiece) completed and turned in the survey. Another indicator of 
the target group's responsiveness was the 60 percent who went well 
beyond a perfunctory ci.:cling of listed items and volunteered no 
less than a full sentence of commentary. In fact, only 13 of the 
96 respondents did not take the time to write something. 

The basic format for reporting the results will be item by 
item. A copy of the cover letter and instrument sent out is 
given in Appendix E. The structured or closed-end responses are 
enumerated initially with the unstructured written results stated 
subsequently. 

Item 1 queried understanding of SIS reports. Of the four 
choices provided, 22 reported "very well", 74 marked "rather well", 
and therefore none fell into the lower two categories. Regarding 
volunteered comments, most centered on the training they had 
received. Three noted that the workshop had been helpful, four 
wrote that the five half-day sessions had been too long, four 
expressed interest in more instruction, and a couple complained 
about the difficulty of quickly finding pages of immediate concern. 

Item 2 inquired about the, general frequency of report usage. 
Fifty, a slight majority, replied "monthly", while 13 and 12 
reported "weekly" and "annually" respectively. Only 3 purported 
to use SIS documents "daily." Another 20 commented to the effect 
that they tended to use the reports as needed or at varying times* 

Results for item 3, regarding the extent and kind of use 
made of the reports (at large, are shown in Table I below). 



TABLE I: Answers To #3; "How vnuch do you refer to the report?" 



Areas Of Use 


Not 
At All 


A 1 
Little 


Some" 
what 


A 
Lot 


Aver- 
age* 


a) To answer staff questions 


2 


27 


54 


13 


2.8 


b) To answer parent questions 


5 


39 


41 


11 


2.6 


c) For discussion In staff mtss. 


1 


19 


45 


31 


3.1 


d) For disc, in community mtgs. 


0 


30 


42 


24 


2.9 


e) To assess needs or develop 
goals for your school 


1 


11 


36 


48 


3.4 


f) To evaluate aspects of your 
schoc' 


1 


6 


44 


45 


3.4 


♦Calculated with a 1-4 point scale with high score meaning I 


ligh 


usage 
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The reader can see readily that overall usage in terms of the above 
areas was reasonably high in all cases. For example, the least 
reported function, "to answer parent questions", had an average 
response of 2.6 or slightly above the midpoint between "a little" 
and "somewhat." The highest areas of use, as shown in the table, 
were e and "f." It should be noted further that needs assessment, 
goal development, and program evaluation—represented by "e" and 

f"— have been areas of highest priority for SIS since its inception. 
Rather few longhat;! reactions were elicited by //3. Four principals 
said they referred to SIS reports for various kinds of planning; 
e.g., "give direction for the coming year." Two cited the reports 
as a tool for decision-making, while sundry others mentioned answer- 
ing questions of individuals, analyzing grade level performance, 
and "comparative purposes . " 

Item 4 asked respondents to indicate their interest in the 
va rious reports . Results are given in Table II. 

TABLE II: Answers To i'/4; "Rank each SIS Report 
in terms of interest for you." 





None 


Low 


Medium 


High 


Average* 


a) Exceptional Characteristics 


1 


12 


35 


45 


3.3 


b) Variable Printout 


4 


10 


49 


31 


3.2 


c) Factor Stanine 


3 


10 


44 


37 


3.2 


d) Variable Stanine 


4 


13 


47 


29 


3.1 


e) Student Survey 


2 


6 


30 


57 


3-5 


f) Teacher Survey 


0 


3 


26 


65 


3.7 


r) Parent Survey 


0 


2 


31 


63 


3.6 


h) Goal Survey 


0 


6 


38 


51 


3.5 


i) Trend Report 


0 


12 


36 


44 


3.3 


1) Achievement Forecast 


4 


7 


32 


48 


3.4 


*Ba8ed on a 1-4 point scale with 4 


meaning 


"high 


tl 







In general, one can note the substantial interest of the principals 
at large in all the reports. Considering the centers of gravity or 
average figures, no report fell below "medium." And the four surveys, 
led by the Teacher Survey, rated above any of the other six reports. 

In an attempt to tease more meaning from the data, they were 
tabulated by elementary versus secondary groups on item 3 as well as 
item 4. Only one sizeable difference in response was found. On the 
Achievement Forecast (j under H) , the average secondary response 
was only 3.0 while that for elementary was 3.5. This unique discrep- 
ancy could have been explained by the fact that this report was yet 
to be prepared on secondary schools while all elementaries had 
received their first Achievement Forecast just a couple of months 
earlier. 
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The fifth item on the final survey of the principals asked, 
"What would you like SIS to emphasize next year?" As intended, 
several gave more than one answer to //5. Better than one third 
(i.e., 33) circled "more help with data usage", 20 specified 
"shorter or ftwer reports", while 19 indicated "more training for 
users." 

Beyond circling the stated choices, more than a score wrote 
out individual responses which have been grouped below into two 
categories — the "positive", meaning more of something is wanted; 
and the "negative", where some improvement is requested. Four 
principals declared their interest in getting more comparative 
information at the sub-district level, especially on sets of 
schools like their own. Four also wanted more trend data, par- 
ticularly that showing student growth. Two called for more test- 
ing, with one of them adding "in all grades." Another two reit- 
erated the now long-term plea for pupil/level data. 

The most frequently requested improvement was to cut the size 
of the reports, with three referring apparently to the number of 
pages (e.g., "a- mass to digest") and two others focusing on the 
physical dimensions of the 14 by 11 inch printouts. Four princi- 
pals criticized the timing of the reports (e.g., "like yesterday's 
newspaper") with a couple of these dubbing, August as a better time 
to make them available. Three commented oh the rather confusing 
way in which they have to switch measurement concepts when going 
from one report to another* Another improvement requested by a 
threesome was greater accuracy or validity of the data; in the 
words of one, "It's okay, as gossip or propaganda." 

Number 6, the final item on the survey, was the most open 
one: "...express in your own words what you think of SIS." The 
most sweepingly negative reaction to the Project, articulated by 
three principals, wa^ that it seemed nonessential. Two of them 
wrote that it has been much like what is already available* As 
one put it, "it tells me little I cannot guess about." A second 
declared flatly that it "should not be funded with local monies." 
The third general critic offered a full-blown diatribe on how the 
guts of what schools should be about cannot be computer programmed. 
A fourth respondent, while conceding some value to SIS, went on 
to put it definitely below his priority for "more help in the 
classroom." 

Four principals attacked project ramifications which were 
really outside SIS control — namely, the uses to which project 
reports have been and have not been directed. Regarding the former, 
one wrote that "SIS stuff is used mainly to show parents why we fail 
in so many respects, to make excuses, to indicate that 'here are the 
reasons we can do only so much.'" On the "have not" side, a couple 
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opined that project documents have had very limited Influence on 
"policy decisions" or on the "instructional program," The third 
sadly coacluded thac "even if we get meaningful information and set 
goals, the lack of money usually precludes doing anything about it." 

Positive or complimentary statements about the School Informa- 
tion System were also rather general. The following quotations 
were selected from the returns of 11 rather like-minded principals: 
"Great improvement over last year"; the reports "grow on me as I 
use them"; we're "just beginning to realize the full potential"; 
keep it, "even if Board funds are necessary"; I was "a skeptic at 
first, but now completely sold"; i^,'s our ''best indicator of present 
status and problems"; "we must have this type of information if we 
are to be given more control over goals and programs." Finally, 
one high school principal's reaction seemed more pragmatic and pro- 
vocative than positive or negative: "When data supports my position 
and direction, beautiful; when it does not.,," 

The foregoing elaboration of results from the recent principals' 
survey can be summarized briefly, A large majority of the District 
principals indicated appreciable understanding as well as definite 
and diverse usage of SIS reports. The candor as welJ as the amount 
of volunteered responses served as undeniable evidence that the 
survey had been well received. 

The report on the final evaluation of the Project would not 
have been complete without presenting at least a few conclusions and 
recommendations. Most generally, results of the survey show the Pro- 
ject to be essentially on target, since its basic objective of reach- 
ing the principals with the Information System has been achieved. 
Nonetheless, there is a fundamental message still to be communicated 
to a number of the principals: That a computer-centered operation 
like SIS is not and may never be a panacea for decision-makers. 
Some comments intimated that SIS might automate principals as well 
as data reports. To this writer's knowledge, no one on the project 
staff has ever seriously conceived of SIS more thaa a tool or 
aide for management. In fact, the emphatically individual and judg- 
mental role of principals may well be enhanced by a computerised data 
bank, since it should give them more time for pursuing other bases 
for their decisions. 

Suffice for generalizations. More specific conclusions follow. 

(1) Training for users has been reasonable successful 
but doubtless can be reinforced. According to the 
survey, the most needed focus would be data utiliza- 
tion, although some further work is also indicated 
for comprehension of key measurement concepts. 



Simplification of reports should be reasserted. 
This process would include (a) the possibility of 
cutting dovm on the number and/or length of re- 
ports and (b) the certainty of developing more 
handy references or indexes • In regard to (a), 
one often discussed prospect has been the conden- 
sation if not eliminaticn of the Variable Stanine. 
As far as references gc, there is already a one- 
page list of practically all SIS data by category, 
and a table of contents is currently being put at 
the front of all school reports housed in the 
centralized Information Center. 

Surveys must continue to be improved. In light 
of their most prominent place in the stable of 
reports, the surveys merit periodic efforts to 
upgrade their validity — to the point that no 
principal will dismiss them merely as "okay for 
gossip and propaganda." 

Subdistrict aggregations should be considered 
again for possible inclusion. At least several 
principals would find this worthwhile in addition 
to national and district-wide Comparisons 
already available. 

Timeliness of the various reports hopefully can' . 
become a system highlight in the future. Getting 
data disseminated before they are a year old 
seems both reasonable and feasible^ At the very 
least, printouts of selected data can be prepared 
much faster than is currently done* 
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Finally, at least one other category of people have been served 
by the Project — those not forioally identified above but nonetheless 
interested in SIS products. For the most part, this "other" category 
referred to non-district people. The project staff has inaintain<*d a 
file of who these people were, what they wanted, and why. 

The "who" ranged from personnel in the area^s Community Chest, 
Model Cities, and Cincinnati's Department of Urban Planning to local 
university faculty and graduate students, from researchers for nearby 
businesses to administrators for the archdiocesan schools, from 
community school associations and board of education members to 
district teachers. At one point, a call was received from a super- 
visor of Job training for the Ohio State Department of Education, 
illustrating that interest sometimes went beyond the immediate 
metropolitan area* 

"What" was wanted and "why" naturally varied too. For example: 
The state department employee sought enrollment and dropout data 
OT' a number of secondary schools in order to answer an inquiry from 
the United States Office of Education, one parochial school admin- 
istrator wanted to sec our survey formats with the thought of devel- 
opins cimilar instruments for his own client populations. The 
municipal government planners were after socioeconomic documenta- 
tion to support an application for a new community service facility^ 
and several community groups wanted loccil school achievement infor- 
mation on which to base impending meetings* The Legal Aid Society 
was trying to determine how many students were taking advantage of 
free or subsidized lunches, so that participation could be encour- 
aged If the need was there. Then the many professors and students 
had eyes for sundry reports depending on their current academic or 
research assignments. 

Resul!:s Outside Expectations 

Exceeding the expectation of SIS staffers were the surprising 
ease of converting survey reports from the IBM to the HP computer 
system, the strong and sustained interest In survey results, the 
consistently favorable reaction by visitors from the outside, and 
the aforementioned success of the several training programs. 

Disappointing our expectation, on the other hand, were the 
small amount of research based on SIS data, the difficulty of 
procuring new and more telling variables, the value of Committee A 
(see the 1971 CGA), the unrequited struggle to convert U. S. Census 
Tracts to school attendance areas (although the possibility is not 
dead), the lack of success In encompassing cost data (largely due 
to the District's traditional mode of recording budgets and expen- 
ditures), and the limitation on the automation effort. To elaborate 
a bit on the last disappointment, a major portion of In-dlstrict 
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data Is not on machine cards but must be copied manually from various 
reports; this is also true of voting data collected from the Board 
of Elections. 

Impact Of The ESEA Title III Project 

It is a genuine pleasure to report that the School Information 
System was picked up by local funds when the Title III grant expired 
April 30, 1973. Moreover, the extent of on-going local support has 
been most gratifying. The current projection is very close to 
$60,000 annually. While the Project's third -year under federal 
funds was about $79, 000 j almost all of the difference is attribut- 
able to the loss of one programmer. In light of the fact that 
practically all of the software had been developed already, this 
cut must be viewed as reasonable and modest. 

The continuity of support level is underlined by no real change 
in the Project's original objectives and activities. Probably the 
most noticeable modification has been in the Project's location. In 
the context of a widely reorganized Central Office, it now operates 
under the Administrative Branch of the Department of Research and 
Development. So it remains in the same department as before but 
under a different branch. 



II . E. Dissemination 

As has been made abundantly clear in the two Continuation Grant 
Applications, the ten or more formal data reports have constituted 
the backbone of project dissemination* To repeat, these computer 
printouts — along with explanatory memorandums on each — have reached 
all 100 of the District's regular elementary and secondary schools. 

Continuing as supplementation to the above have been (1) writ- 
ings from or about the Project and (2) oral presentations and dis- 
cussions basied partly and sometimes wholly on SIS materials* The 
writings usually have been brief, ad hoc items appearing In SIS 
Quiks , the project newsletter, or in R&D Briefings and Informa- 
tion H ighl ights , newsletters for the Division of Program Research 
and Design. The oral activity has revolved around staff and com- 
munity meetings at Individual schools (e.g., see p. 3A in the 
second CGA) . 

A recent addition to the vehicles for project dissemination 
has been the "School Reports." A sample of these is given in 
Appendix F. While not explicitly identified with SIS, their con- 
tents were taken therefrom. The School Reports were prepared in 
January and February, the used in March and April in conjuntion 
with the District's campaign to pass a school tax levy* 
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The cost of dissemination activities has always been difficult 
to determine because of the inhere;*t place they have in the Project. 
By Including duplicating costs, clerical services, as well as pro- 
fessional staff time, the project manager estimated an expenditure 
of $25,000 for 1972-73, So the three-year total was put in the 
neighborhood of $75,000. 



II. Recommendations 

The following recommendations are being presented under general 
categorial headings to which they most directly relate: 

A. Personnel 

To effectively operationalize the system presented in this 
report nt the very minimum five full-time people should be 
employed. Job titles and brief descriptions of each are: 

Manager of the System 

Management training and experience are of necessity 

System's background 

Research and evaluation skills 

Reporting skills 

Speak well and communicate effectively 

Two (2) Progr a mmer Analysts ' 
Experience in the field of data processing as programmer 
and analyst 

Formal training in system's design and mathematics 
Knowledge of statistical principles 
Communicate effectively and cooperativenes? 

Statistical Clerk 

High threshold for detail work 

Favorable attitude 

Experience and proficiency in using a calculator 
Ability in dealing with numbers 

Senior Stenographer 

Must possess high quality secretarial skills 

B. Data Collection 

At the outset of developing such & system careful attention 
should be given to what data will be collected, who will 
collect the data, how It is to be collected, when it is 
available^ and how is the data available; l«e» • hatd copyi 
on punch cards disk, tape, etc. 
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If no specific department or divis^on^ has this responsi- 
bility! then such a department or j^roup of people should 
be identified to carry out the above details. 

C. Training and Use 

Much time should be spent in developing materials on how 
the system is to be used. Examples and "real life" situ* 
at ions sho%ild be used to show how to make use of the sys* 
tern. 

At least a two week period of time should be set aside 
for training users and potential users of the system. 
Then I continued follow-up and ad hoc training should 
take place throughout the course of one year for new 
users of the system. Additional training should take 
place for any modifications in the system that may 
occur. Materials should be prepared in advance that 
can be used for individual or self instruction or up- 
dating. 

D. Data Processing 

Hardware : Some generali^able system specifications that 
should be as closely met as possible include: 64K stor- 
age capacity I two disk drives » two tapes » plus peripheral 
gear; i.e., key-punch machines » scanning machines* card 
sorters, etc. 

Software : Much of the software (programs) produced by 
SIS is transferable and adaptable— assuming some compati- 
bility in hardware. SIS programs can be used on IBM and 
Hewlett=-Packard machinery. 

It would be to the system* s advantage to plan work tasks 
at least six weeks in advance In order to give programsier/ 
analysts sufficient time to write, test, and -^de-bug" 
programs. In this way this should ensure the production 
of reports when promised. 

E« The Larger Operating System 

It should be clearly identified where in the larger 
organization or operating System the management and 
evaluation system will fit. Organisationally speaking, 
it should be determined who will the manager have to 
report to, what freedom will the management and evalua-^ 
tion system have in producing reports, how much ($) 
support can they expect presently and over the next 
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five years. It should also be determined beforehand the 
attitudes of existing staff toward your incoming system* 
Are they receptive? Do they want to use it? Does it 
seem to make sense? 

F. The Decision Maker and Categories of Decisions to be Made 

What seemed to be the simplest tasks to be performed^-* 
trying to determine who the decision makers were and what 
decisions they make — turned out to be the most difficult. 
Reasons for this included the fact that decision makers 
do not always know what decisions they do or can make, 
and what data they want. Further, for a project staff 
it is a most difficult task to try and determine who has 
*'sign-off** authority. With this as background, it is 
strongly ft^lt that if there is one particular thing that 
can lead to a lot of wasted effort it is not knowing who 
you should be providing information to in order to cssist 
in the decision*making process. Therefore, it is recom* 
mended that this assignment be given high priority in 
trying to establish a School Management and Evaluation 
System. It is felt thkt if the task is carried out 
adequately, much will have already been done to begin 
operationalizing an effective School Information System. 

G. System Design 

Critical attention should be given to how the data base 
will be established* To answer this question, the fol- 
lowing concerns must first be addressed; 

1. What kind of reports will be produced? 

2. At what time? 

3. How soon do people need the data/Information? 
4* What kind of decisions will be made? 

It is felt that depending on how these questions are 
answered only then will the necessary direction be given 
regarding the need for an **on*line** system, whether re- 
ports can be produced in batch mode, or whether or not 
you need a combination of the two* 

H. Committee 

Before establishing comnitteea to work with on projects, 
m^ike positively sure the Project needs this type of 
structure and be willing to put in much time and effort 
to work with a committee* Remember, people working on 
the Project are more involved than committee members* 
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Hence, much time in committee work is spent on constantly 
bringing committee people up-to-date. Therefore, as far 
as Project personnel is concerned, they are going over 
matters they already addressed, in some cases, one month 
previous. 

On the positive side of the ledger, depending upon who 
committee members represent and their position(s) in 
the existing organization, a committee could be an 
invaluable mechanism in assisting a Project to continue 
under local Education Agency dollars. 



II. G. Abstract For Eric 



School Information System: 1973 Report 
Cincinnati Public Schools 



Picked up by ESEA Title III in 197Q, the School Information 
System (SIS) was designed essentially to furnish school adminis- 
trators with data and information on which to make better deci- 
sions* The basic means were to (1) build and improve a data bank, 
(2) prepare and disseminate computerized reports (to the decision- 
makers — especially school principals), avA (3) train them to 
understand and ultimately to use the reports in their management 
of /schools. 

Results generally exceeded expectations* As illustration, 
by the end of the third year, all of the 96 principals (of the 
98 total) responding to a survey reported they understood SIS 
reports "rather well" or "very well", while a consistent majority 
said they used the reports at least monthly for a half-dozen dif- 
ferent functions. 

In addition, the reports turned out to have considerable 
appeal to community and parent groups plus central office 
personnel — as well as for the principals and assistant principals. 
Perhaps most indicative, a major part of project costs were picked 
up by local funds after the Title III grant expired April 30, 1973. 
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SUMMAXIVE EVALUATION REPORT 
Using Information for Decision Making 



SIS Management Training Program 
August 21-25, 1972 



CINCINNATI PUBLIC SCHOOLS 
Division of Program Research and Design 



SUMMATIVE EVALUATION RLPORT 
Using Information for ueclslon Making 



SIS ManageioenC Training Program 
August 21-25, 1972 

INTRODUCTION 

Purpose 

Aim of Report * This report presents the summatlve evaluation of the 
management training program conducted for principals and assistant princi- 
pals of the Cincinnati Public Schools by the staff of the School Informa- 
tion System (SIS). The information presented here is intended to provide 
a comprehensive evaluation of the program. It should serve any and all 
decision makers who need information connected with any of the purposes 
set down in the evaluation plan. It should also provide, for tiie partl«* 
clpants and any other Interested persons, detailed perspective on the 
degree to which the training program accomplished its objectives. 

Purposes of Evaluation . Four distinct purposes for evaluating the 
training program were set down in the evaluation plan devised as the 
training program was formulated. These were: 

1. To disclose specific needs for post-program inservice 
training of administrator's by indicating deficiencies 
.in the accomplishment of program objectives. 

2, To assess the extent to which principals accept and 
undetstand the School Information System. 

3* To suggest program modifications that are likely to 
improve the quality of the program as it is replicated 
for other audiences. 

4« To provide adequate process evaluation to insure that 
any concurrent program niodif icaticns that are crucial 
will be made kno%m to the program administrators. 
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The order in which these four purposes are listed was seen as indica- 
tive of their priority* In other words, determining post-program inservice 
training needs was seen as the most important purpose, while process 
evaluation directed to immediate program modifications was considered least 
important. 
Plan of Report 

Major DivlaionB > This report is orgar^?.?ed into five major divisions; 
Intrt^uctlon, Evaluation by Subgoal, Total Program Evaluation, Conclusions, 
and Recommendations* After this introduction has presented the rationale 
and (Organization of the report, the next two sections will revert evaluation 
results. The second division of the report will look separately at each of 
the eight subgoals of the training program* Data collected through the 
various evaluation instruments will be presented to indicate the degree of 
success in achieving the objective's under each subgoal. 

In the third division of the report, information :^^^lAted to evaluation 
of the overall program will be discussed. The chief ^^jg^phasis of this 
section will be on the process infv^rmation provided to the directors in 
the course of the training program* While the section on subgoals will 
serve primarily the first evaluation purpose stated above, this global 
evaluation section will be directed to the second, third, and fourth 
purposes* 

The evaluation plan set down the three product instruments that were 

used to collect Information for evaluation. These were: 

a. Participants' Ratings (post only) — current level of 
understanding, increase of understanding, worthwhile- 
ness of program components* 

b* Content Test (pre and post) — checklists, true-false* 

c. Test Simulation (pre and post) — true->false and rating 
questions based on selected data for a hypothetical 
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In addition^ two techniques were designated for gathering process 
Information. Members of the evaluation staff were assigned to Interact 
with program participants, especially during coffee breaks, A suggestion 
box was provided, through which participants could submit comments at 
any time. These process techniques proved helpful in gather Ing evaluative 
data. 

Sub goals . The eight subgoals of the program were as follows: 

1. To provide principals an opportunity to review and 
apply 1971-72 SIS data to specific task situations. 

2. To assist principals in acquiring a functional know- 
ledge of SIS. 

3. To assist principals in the use of SIS data for 
decision making relating to goal setting and problem 
identification. 

4» To assist principals in the utilization of SIS data 
in program evaluation. 

5. To assist principals in the interpretation and use of 
the Student, Teacher, and Parent Surveys. 

6. To assist principals in communicating Information to 
staff, students, and the public* 

7. To provide knowledge about the nature and qualities 
of decisions and information. 

8. To show the relation between SIS reports and account- 
ability. 

EVALUATION BY SUUGOAL 
I. Application to Task Situation 

Objective a . All principals attending the training program will parti- 
cipate in the application of a task situation to their 1971-72 SIS reports*— 
WOT ACHILVIO). 

The final day of tlie program featured an opportunity for participants 
to engage in an extended analysis of their individual sciiool reports. An 
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exercise was provided to guide them In their study of the data. This 
conponent was viewed by the program planners as the culminating activity 
of the entire week. 

Unfortunately, computer programming difficulties made it impossible 
to have the senior high school reports ready. Members of the SIS staff 
worked throughout the night to remedy the difficulties, but to no avail. 
Thus, although a large majority of the administrators in attendance 
participated in the exercise, non-availability of the senior high school 
reports must be considered a serious shortcoming. 

Objective b . On the participants* rating instrument, this activity 
will rank among the three program components seen as most useful — ^ACHIEVKD. 

The participants' rating Instrument, administered at tiie close of the 
workshop, asked administrators to rate each of 13 program components. The 
ratings, based on a five-point scale, were to reflect the respondents' 
Judgments of the usefulness of what they had learned from each component, 
'^'he mean rating given each component by elementary and secondary admini- 
strators is shown in Appendix Table 1. 

Elementary participants gave the culminating exercise a mean rating 
of 4.01; secondary administrators rated it 4.09. These means indicate 
that the respondents saw the analysis of the individual school printouts 
as the single most useful program component. Interestingly, the mean 
rating by the secondary administrators was slightly higher than that by 
the elementary group, despite the fact that the senior high school reports 
were not available for this exercisa. It should be noted that several 
of the senior high school group simply did not respond to this item. 
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2> Functional Knowledge of SIS 

Objective On a checklist of real and fictitious variables on the 
content test» the number correctly identified as those in SIS will show 
some Increase from pre- to post-test. Further^ the number correctly 
identified by individual participants will increase for at least 75 per 
cent of the respondents — ACHIEVED. 

Three of 13 program components were oriented primarily to giving 
principals a functional knowledge of SIS, l.e.^ increasing their under- 
standing of what the information system contains and what this information 
means* The relevant section of the content test listed ten variables^ 
seven real and three fictitious* Without knowing the correct number » 
respondents were to identify those actually contained in SIS. Each item 
in tte list was scored as correctly or incorrectly designated. 

On the average^ elementary participants correctly designated 6.41 of 
the ten variables on the pre*-*test and 8.65 on the post-test. For the 
secondary group, the increase was from 5*33 to 8. 00. Seventy-eight per 
cent of the elementary participants and 84 per cent of the secondary showed 
an Improvement in scores. 

Objective b . Given a checklist of questions that one might try to 
answer with SIS data, participants will be more successful on the post-test 
than on the pre-test, in selecting those that can actually be answered. 
Increase in the mean and Improvement for 73 per cent of the participants 
will be used as criteria — NOT ACHIEVED, 

A second section of the content test consisted of a list of six 
questions, of which three could actually be answered with SIS data. 
Administration and scoring of this section corresponded to the procedures 
applied to the checklist of variables. Of the six questions llBted, 
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elementary principals correctly designated an average of 3.07 on the pre- 
test and 3.22 on the post-test. Secondary means were 2.85 and 3.17 on 
pre- and post-test, respectively. However, only 40 per cent of the 
elementary and 48 per cent of the secondary respondents showed a gain for 
this section. 

Objective c . Participants' ratings of the program components related 
to functional knowledge of SIS will yield a mean at or above the mld-()olnt 
of the scale—ACHIEVLD. 

In general, the administrators participating in the program rated the 
components related to this subgoal above 3.00, the mld-polnt of the scale. 
The mld-polnt was labeled to Indicate a Judgment that the knowledge gained 
was "fairly useful." 

Second ranked among the 13 program components was the exercise of tlie 
second day In which participants engaged in an interpretation of data on a 
hypothetical school. Secondary principals rated this activity on par with 
the analysis of their own schools' reports. Their ratings averaged 4.10, 
compared to 3.82 for the elementary group. 

A fourth-day address by Dr. Harry Smith, Dean of the School of 
Management, Rensselaer Polytechnic Institute, was also associated with 
this subgoal. This speech, entitled "Potential and Limitations of SIS 
and Some Guidelines for Interpretation," followed a panel discussion by 
several comnunlty leaders. Elementary participants rated Dr. Smith's 
address 3.77, while secondary ratings averaged 3.69. This speech ranked 
seventh among the 15 components. 
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The third component associated with this subgoal was an address by 
Dr. Robert P. Curry, Deputy Superintendent of Schools. At the opening 
of the prograiUi Dr« Curry discussed the development and service function 
of SIS. With mean ratings of 2.90 and 3.0^8 by elementary and secondary 
participants, respectively, this address ranked fourteenth among the 
program components. The average elementary rating was one of three 
means (among all components) that fell below the scale's mid-point. 
3> Goal Setting and Problem Identification 

Objective a . In the test simuiation, there will be an increase 
from pre- to post-test in the mean number of correct responses to items 
involving the use of data in goal setting — ACUIKVED. 

The test simv:ilation^ which purticipants completed before and after 
the program, included a set of hypothetical data and a variety of related 
questions. On the five items concerning the use of data in goal setting, 
elementary principals increased their average number of correct responses 
from 3.93 on the pre-test. to 4 .15 on the post-test. The increase for 
secondary administrators was from 3.02 to 3.83. 

Objective b . In the test simulation, participants' rating of five 
equally valued goals on the basis of a comparison between hypothetical 
school data and city-wide averages will show closer agreement with Judges' 
ratings on the post-test than on the pre-test — ACHIEVED. 

Prior to the training program, a panel of four judges ranked the five 
goals listed on the test simulation. Their rankings showed reasonable 
reliability, with unanimity on the highest and lowest priorities. 

The participants' mean ranks were compared with the Judges* means. 
The objective called for the differences between the participantii ' rankings 
ftiud Judges' rankings to decrease from pre- to post-test. The results are 
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Table 1. Differences Between Mean Ranks Assigned Co Goals by ParcicipanLs 
and Judges. 



Goal 


Elementary 
Pre Post 


Secondary 
Pre Post 


Improved school— cotnniunl cy relations 


.95 


.5U 


1.18 


.47 


Improved staff taorale 


.99 


.88 


1.11 


.92 


Improved student attitudes 


l.UO 


.51 


1.44 


.56 


Improved reading achievement, primary 


1.05 


.95 


1.29 


.96 


Improved reading achievement, Junior iilgh 


.98 


.51 


1.01 


.72 



The differences reported in Table 1 indicate accomplishment of this 
objective. Pre-test differences were fairly consistently 1.0, wliile those 
on the post-test ranged from •^l to ,96, with a mean of .71. 

Objective c . On tlie content test, there will be an increase from pre- 
to post-test in the mean number of correct responses to items conci^rned 
with various needs identification techniques — AChlLVLU. 

The third related objective called for an increase from pre- to post- 
test in the number of correct responses on relevant items on the concent 
test. The four items in ttiis category show a mean increase from 3.17 to 
3.25 among elementary administrators and from 3.10 to 3 .AO among secondary 
administrators. Again, the objective was achieved* 

Objective d > Participants' ratings of program components related to 
Qoal setting and problem identification will yield a mean at or above the 
mid-point of tlie scale — ACIIILVKU. 

Three components v/ere directed toward the accomplishmenL of the siibgoal 
related to goal setting and problem identification. Both the elementary and 
secondary groups rated all three components higher than 3.00. Compared with 
other presentations and activities, though^ these three components were 
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Icsa well received than most» ranking nlnth^ tenth* and twelfth amon& the 
15 components. 

A group-declslon^TTiaking exercise^ based on the Ohio Riot Cummisslon 
Report, was presented near the end of the first day, KlcmeiUary partici- 
pants rated the usefulness of what they learned from thl& exercise at 
The secondary mean was 3.56. 

Ranking sllglitly behind the group decision making exercise wan the 
goal setting simulation of the third day. Consistent with nearly ail other 
ratings, secondary participants (3.33) saw the exercise as having somewhat 
greater utility than elementary administrators (3.iU). 

Finally, a second-day address by Mr. Bernard H. Barbadora, Ilaiiai^er of 
the School Information System, built on the exercise in group decision 
making and emphasized key principles. The mean ratings for ttiis component 
were: elementary, 3.05; secondary, 3.32. 
4. Program Evaluation 

Objective a . In the test slmulationi there will be an increase from 
pre- to post-test in the mean number of correct responses to items concerned 
with evaluating a program of non-gradedness based on hypotlietical school 
data— ACKIEVEU. 

Five Items in the test simulation pertained to the use of SIS data in 
program evaluation. Elementary principals answered an average of 3.00 
correctly on the pre-test and 3.44 on the post- test* The secondary mean 
increased from 3.16 to 3.70. 

Objective b > On the content test, there will be an increase from pre- 
to post-test in the mean number of correct responses to items concerned wit^i 
the role of program evaluation in local school program development — ACUIKVEU« 

Similar success was achieved with regard to the second program evalua- 
Q tiou objective, which called for a inean increase among four items on tltc 
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content test, liere the elementary mean went up from 2.06 to 2s>70, ar<d the 
secondary from Z.14 to 3. 06. 

Objective c> Participants* ratings of program components concerned 
with program evaluation will yield a mean at or above tlic mid-point of the 
scale--ACHIEVED» 

Only one component dealt primarily with using SIS for program evaluation 
This was a third*Klay address by jjr. Joseph L. Fellxi Associate Director of 
the DivlrSion of Program Research and Design. Elementary administrators 
gave this presentation a mean ratint^ of 3.b7, and secondary admlnistratore, 
4.02. Tliese means ranked Dr. Felix's address fourth amon); tfiu 13 program 
components. 

5 , Interpreting and Using Surveyg 

Objective a . In the tesi simulation there will be an increase from 
pre"- to post«'test in the mean number of correct responses to iLem^j con- 
cerned with the use of survey data in goal setting — ^ACUIbVLD. 

Four of the five true-false goal--setting items in the test simulation 
were based on the use of survey data. All four showed an increase from 
pre«* to post-test in the percentages of correct answers given by both 
elementary and secondary participants. 

Objective b . In the test simulation, there will be an increase from 
pre- to post- test in the mean number of correct responses to items concerned 
with the use of survey data in evaluating a program of non-gradedness-^NOT 
AChlbVED. 

Only one of the five* program evaluation items in tlic test simulation 
was linked to survey data. This was a controversial item on which even the 
program coordinators disagreed. Although there was an increase in the 
percentage of elementary participants answering the item according to the 
key^d reaponse (21Z to 24Z)» the secondary percentage declined (SOZ to 38Z). 



Objective c . On the content test, there will be an Increase from prc- 
to post-^test In the mean number of correct responses to items concerned 
with the use of survey data — ACUILVLD. 

Four content teat Items focused directly on the interpretation and use 
of surveys. Of these, the elementary group answered an average of 2.89 
correctly on the pr^<-test and 3.38 on tlie post- test. The secondary mean 
increased from 2.86 to 3«A0. This objective was attained successfully. 

Objective d . Participants* ratings of program components couccrued 
with tiie use of survey data will yield a muau at or above the mld-poitit of 
the scale— AChlLV Li). 

One of the few components that received a higher rating from cicnlcat^Jry 
tlun from secondary administrators was the fifth day's presentation on tin? 
use of surveys* This was the only component related primarily to this 
subgoal. Secondary principals irated this presentation slightly below tlie 
scalers mid-*point (2.88). The elementary rating, however, (3.0U) raised 
the total mean for both groups above 3.00, so that the objective was achieved 
6. ComnKinicating Information 

Objective a . Participants* ratings of program components concerned 
with communicating information will yield a mean at or above the mid-point 
of the scale^-ACHILVlilD. 

Two components were related primarily to techniques for communicating 
information. Ratings given to both presentations by elementary and secon- 
dary groups were comfortably above the mid-point of the scales 

Fif th-*ranked aiaong the 13 components was the panel discussion, *'Witat 

the Public Wants to Know.** The mean secondary rating for this component 

{i^OS} As nearly as high as those for the top-ranked exercises on analyzing 

and interpreting SIS reports. Elementary participants gave a mean rating 
O 

£pT(];).73 to Che panel discussion. 
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Kanking eleventh was Che dramacic presencaclon of Che third day 
coordinaced by Miss Joan bollenbacher , Director of the Division of LValua- 
tlon Services. Mean ratings were: elementary, 3.20; secondary, 3.29. 

Objective b . At the close of the training program, participants, on 
the average^ will rate their current level of understanding of communica- 
tion techniques suited to staff, students, parents, and other community 
members as at least adequate for present purposes — NOT ACHILVLD. 

None of the cognitive measures contained on the test simulation or 
coivcent test related to understanding of communication techniques. Because 
of the relatively low priority of this subgoal, the evaluation was based 
entirely upon the ratings given by participants at the close of the work- 
shop. On one section of the participants' rating's JnstrumcnL, administra- 
tors were asked to evaluate their knowledge. For each area, they indicated 
how adequate they felt th<^ir current understanding to be and how much their 
knowledge had increased in the course of the training program. Adequacy of 
current understanding was rated on a three-point scale^ wliiie increase of 
knowledge was rated on a seven-point scale. 

For the communication techniques content area, the ratings of both 
elementary and secondary participants fell slightly below the mid-point 
of the scale. Elementary administrators gave a mean rating of 1.U7; 
secondary, 1973. Thus, the ratings of both groups averaged somewiiat 
below tlie standard of ''adequate for present purposes." 

Objective c . Participants* ratings of their increase of understanding 
of communication techniques will yield a mean equal to or greater than the 
mlnlnum predicted mean for a measurable increase. The prediction formula 
will be derived from the regression of the ratings of increased understand- 
O init, on nre-post content test differences in subgoals 2 through 5 — NOT 
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The portion of the participants' ratings InHtrumenls on wlilcli tlicy 
were asked to Judge their Increase of knowledge was developed In an attempt 
to cO!q)en8ate for the lack of cognitive measures related to the last thrci: 
subgoals* Because both prc-post cognitive measures and judgments of know*- 
ledge Increase were available for subgoals 2 through 5, the plan was to 
relate these two measures to each other and develop a regression equation 
which would help e^tubllsh a minimum standard for estimates of knowledge 
increase* Tills standard was based on a cognitive-measure iucreasde of one 
point* It was computed separately for the elementary and secondary griHips. 

For elementary administrators, the minimum standard established 
through the regression equation was 4.64; the rating given knowledge 
increase in comnunication techniques was 4*34. For the secondary group, tiie 
regression equation set the minimum standard at 4.72; the racing for tltis 
area was 4«;Z9. 

It should be noted, however, that tiku validity of the above comparison 
is limited by the low correlation between measured cognitive increases and 
participants* ratings. For the elementary group, v:hiB correlation was .07, 
and for the secondary, .J2. 

In this light, one might ask how participants perceived tiie knowledge 
increase in this area as compared to that for the areas under subgoals 2 
through 5. This means of eval^^ating the ratingfv yields still less favorable 
results. Tlie average rating of knowledge increase for the other four areas 
was 4.71 for elementary participants and 4.97 for secondary participants* 
It can safely be said, therefore, Ituit participants felt ttiey had gained 
less knowledge in this area tlian those under subgoals 2 through 5* 
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!• Nature and Qualities of Decisions and Information 

Objective a . Participants' ratings of program components related to 
decisions and Information will yield a mean at or above tlic mld-polnt of 
the scale-'-ACIilLVED. 

Three of the 15 components were directed primarily toward the accom- 
plishment of this subgoal. In general, the average rating of tliese three 
components were above the 3*00 mld~point* 

Or. Harry Smith presented an address entitled ''Management Information 
Systems as TH^ey Relate to School Administrators.*' Thla speech was {-iven 
on the fourth day, prior to tlie panel discussion, Lieinentary participants 
gave the presentation an average rating of e.72, wiiile the secondary mean 
was 3 •96. This address ranked sixth among the 13 components • 

Ur. James Jacobs, Director of the Division of Program Research and 
Design, spoke on "Principles of Using Information" on the second day of 
Che training program. Elementary participants rated his presentation 

while the secondary administrators gave It 3.39. Dr. Jacobs' 
address ranked eighth among the 15 program components* 

Lowest ranked of the 15 program components was an address by Mr. John 
Faust, Assistant Superintendent of the Cincinnati Public Schools. 
Mr. Faust's speech, given on the fifth day, was entitled "The Relation of 
SIS to a Management Model." Tlie elementary rating for this component 
was 2.56; secondary administrators rated it 3.00, 

Objective b . At the close of the training program, participants, on 
tile average, will rate tlielr current level of understanding of the nature 
and qualities of decisions and Information at least adequate for present 
purpo8cs<-->ACHIKVED. 
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On the three-point scale used for rating current level of understand- 
ing, elementary principals rated the area of the nature and qualities of 
decisions and information at 1.95. The mean secondary rating was 1.98. 
because both ratings are within .05 of the scale's tnid-poinl It seems 
reasonable to judge that this objective was successfully achieved. 

Objective c . Par-ticipants' ratings of their increase of understanding 
of the nature and qualities of decisions and information will yield a mean 
equal to or greater than the minimum predicted mean for a muaiaurablc 
increase— NOT ACHIEVLD. 

Using the method described under objective c of subgoal 7» partici- 
pants* ratings of their increase of understanding in this area were compared 
with the mininum standard derived from the regression equation* With a 
mitiiiAim standard of 4*64^ the elementary group rated their knowledge 
increase 4,36* The standard for the secondary group was ^.72^ and tht^ 
mean rating for this area was 4*37« 
d. Accountability 

Objective a . Participants' ratings of program components concerned 
with accountability will yield a mean at or above tiie mld-polnt of the 
scale— ACHILVIO). 

Only one component was directed primarily to the subgoal. This was 
an address by Dr. Donald K. Waldrip, Superintendent of the Cincinnati 
Public Schools, on the third day of tlte training program. This presenta- 
tion ranked third among the 15 program components^ receiving higher 
ratings than any other speaker-to-audience presentation* Elementary 
participants gave Dr. Ualdrip's address an average rating of 3«88« The 
secondary inean was 
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Objective b « At the close of the training program, participantB, 
on the average, will rate their current level of understanding of accounta- 
bility as at least adequate for present purposes — ACHILVEU. 

On the three-point scale used for assessing adequacy of current 
under standing, elementary principals gave a mean rating of 1.99 to their 
knowledge of accountability* The secondary mean was 2.11. The average 
rating for both groups may be said to have achieved the mid-point of ihc 
scale which was described as ^'adequate for present purposes/' 

Objective c « Participants' ratitigs of their lucreasod understand liij* 
of accountability will yield a mean equal to or ^>rcatcr than LhL* miulmum 
predicted mean for a measurable increase — NOT ACliLEVEU* 

With a minimum standard of 4.72, secondary principals rated their 
increase of knowledge of accountability at 4.41« Llementary principals, 
on the other hand, gave the mean rating of 4.79, compared to a minimum 
standard of 4,64. Specifically, then, this objective may be said to have 
oeen accomplished for the elementary group but not for the secondary. Tiie 
mean rating among all participants, however, was less than the minimum 
standard for the total group. 

TOTAL PJIOGIIAM LVALUATION 

Product Instruments 

Total Scores > Frequency distributions were made of the total scores 

achieved by elementary and secondary participants on the tost simulation 

and content tests* Scores were based on 38 items across these two instru- 

inuuts for which responses could be; designated correct or incorrect. On 
tl.i*:>o M Items, GO elementary administrators who took complete pre- and 
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post-tests gained an average of 5,A from pre- to post-testy. Tliclr mean 
pre-test score was 21.6, and their mean post-test score was 27.0. Korty- 
one secondary participants with complete tests averaged 19.7 on the pre- 
test and 27.3 on the post-test for a mean gain of 7,6. 

Quartlles were also computed for tlj'^ frequency distributions. Theac 
are shown In Table 2. 

Table 2, Quartlles In the Distribution of Scores on Cognlllve Measures, 
by Croap and Test Administration (lc«38). 

Elementary Secondary 
Pre-Tcst Post-Test Pre-Tcdt Post-Tewt 





20.7 


30. '> 


25.8 


31.2 




24.1 


28.1, 


21.2 


28.5 




16. a 


25.5 


15.3 


25.0 



Component Ratings » To evaluate the various components of this train- 
lag program In terms of the desirability of Including similar material In 
future replications, a sumiuary of the ratings given to the various compo-^ 
nents might be helpful. Such a summary is provided in Appendix Table 1* 

This summary reveals quickly what has been spelled out at length in 
the evaluation of program subgoals. Participants were generally very 
satisfied with the quality of the program components. All 13 components 
were rated by at least one of the two groups at or above the mid-point of 
the scale. Thirteen of them had total means above the mld**polnt. Bused 
upon these ratings, none of the components appears unworthy of considera- 
tion for possible inclusion in future programs. 
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Proceaa Technlguea 

Interaction with Evaluators > Members of the evaluation staff of the 
Division of Program Research and Design were assigned to Interact with 
program participants^ chiefly at coffee breaks, throughout the week. Each 
evaluator submitted a brief written report of comments received and obser- 
vations made« 

The general tenor of these reports throughout the week was highly 
favorable. Attitudes of the participants toward the program seemed to 
develop somewhat according to the following description: first day — wait 
and see; second day — not bad; third day — well planned with good content; 
fourth day — one of the best workshops ever attended. 

Specific process Information was given to the program coordinators 
at the conclusion of each day^ There Is no need to repeat the details 
here. Principals saw the content of the program as worthwhile* They were 
very Impressed by several of the speakers. They felt that the entire 
program was well thought out. 

Two negative themes that appeared with some frequency in the evalua- 
tors' reports deserve mention* Most common was an unfavorable reaction 
to the time of year when the program was held. Principals were disturbed 
by an awareness that some Important tasks related to preparing for the 
opening of school were being left unattended. As one evaluator noted, 
Iiowever, participants who were questioned about a more desirable time were 
unable to offer a practical suggestion* 

The second negative theme was an infrequient expression that there 
seemed to be some redundancy in program content. A few of the random 
evaluative comments suggested that some time could be saved and the program 
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made more compact If repetition were eliminated and the program offered 
for full days rather than half days. 

Sm^gestlon Box , In the suggestion boxes made available to program 

) 

participants, a total of 20 entries were submitted during the course of 
the program. Eight of these contained suggestions for improving the 
data printouts offered by SIS. Five others made suggestions for the 
workshop itself (interestingly, only one related to the time of year at 

which the program was offered). Two of the suggestion box submissions 

; 

provided general, positive evaluative comments on the workshop. Two 
others were requests to check the accuracy of data on individual schools. 
Three miscellaneous comments were submitted. 

1 

The following selected ideas represent the most useful material fromj 
the suggestion box: 

— more systematic input from principals to SIS 

~ appointment of principals' liaison to Program Research and Design 
comparison among schools of equal SES 

longitudinal comparison for each school to indicate trends 
provision of multiple copies of printouts to schools 
~ table of contents to locate specific areas of data 

— listing the page number of the data behind each exceptional 
characteristic 

— use of the same unit of measurement throughout the printouta 

— offering a comparable workshop for teachers using closed-circuit 
TV on inservice day. 
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CONCLUSIONS 

From clie evaluation of each program subgoal and that of the total 

i 

workaliop it la possible to draw several conclusions. 

1, In general 9 the training program may be labeled a }iighly 
successful inservice effort, eighteen of the 25 evalua- 
tive objectives were achieved. These included at least 
one objective under each o£ the eight subgoals. 

2, Non-delivery of the senior high school reports was the 
most serious deficiency of the program. For all of the 
other six objectives that were not achieved, the success 
criterion was missed by a narrow margin. In general, 
these^objectives also represent the weakest areas of 
instrumentation. 

3, All objectives were accomplished under two subgcals. The 
training program proved most successful in achieving the 
objectives related to goal setting and problem identifica- 
tion (subgoal 3} and program evaluation (subgoal 4} • 

4, The areas seeming most in need of follow-up attention ^re 
the application of SIS data, functional knowledge of the 
system, and communication tecliniques, 

5, Total evaluation results point to a high degree of accep- 
tance of' SIS. The attitudes of the participants appeared 
to grow increasingly favorable in the course of the train- 
ing program. The perception that the workshop contributed 
to their effectiveness as administrators almost certainly 
made participants' attitudes toward SIS more strongly 
positive. 

6, None of the 13 program components was rated so low as to 
dictate its being eliminated from future replications. 
Each component was rated at or above the mid-point of the 
scale by at least one of two groups. 

7, Process techniques used in evaluation contributed to the 
assurance that the workshop was seen as useful by the par- 
ticipants. In addition to the several suggestions for 
minor modifications during the program, the process evalua- 
tion yielded several constructive ideas for modifying SIS 
reports and future workshop attempts. 
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RECOMMENDATIONS 

Recommendations derived £rom the evaluation results focus on the first 
and third purposes outlined in the evaluation plan: identification of 
post-program inservice training needs and suggestions for future replica- 
tions of the program. 

1. The chief focus of inservice training related to SIS 
should be on continual strengthening of principals' 
functional knowledge of the system and tlieir ability 
to apply it to decision making. A systematic attempt 
should be made to link this training to the concept of 
accountability* Principals are seen as leaders in the 
use of SIS information for educational decision making. 
Some of the program participants will ne?;id continuous 
motivation and assurance if they are to fulfill this 
aspect of their leadership roles. 

2. Participants are also in need of additional h&lp with 
techniques for communicating evaluative information. 
Portions of principals' conferences, a seminar offering, 
or even an additional workshop mi{/jit be suitable meane 
of meetliiig this needt 

3. In future program replic^ntions the essential structure of 
the program should be kept relatively intact. Thcire 
seemed to be a proper balance between didactic presenta- 
tions and learning activities. Unless there is good 
reason to modify this t^tructure, its success probably 
warrants continued use. 

4. The co:i'itent of components of the training program should 
be scrutinized to determine their appropriateness for 
future target groups. In general, the sessions most highly 
valued by participants in the original program should be 
given preference unless the specific needs of the target 
audience dictate otherwiae. 

5. Consideration should be given to making future replica- 
tions more compact by excliangliig half-day for full-day 
sessions. This preference ctu the part of a number of the 
original participants may also characterize future target 
groups. 
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Appendix Table 1« Mean Participants' Ratings of 

Components by Level* 


the Usefulness 


of Program 


Component 


Eli>.mentary 
(N-71) 


Secondary 
(N-55) 


Analysis of 1971-72 Reports 


4,01 


4.09 


Interpretation of SIS Reports 


3*82 


4,10 


Waldrip: Accountability 


3.88 


4,02 


Felix: SIS in Program Evaluation 


3,87 


4.02 


Panel: What the Public Wants to Know 


3.73 


4.08 


Smith: Management Information System 


3.72 




Smith: Potential of SIS 


3.77 


3,69 


Jacobs: Principles of Using Information 


3,45 


3.59 


Exercise in Group Decision Making 


3.30 


3.56 


Goal Setting Simulation 


3.19 


3.53 


Bollenbacher: Interpreting Achievement Data 


3.20 


3.39 


fiarbadora: Data Usage and Group Involvement 


3.0j 


3.32 


Varland: Use of Surveys 


3.08 


2.88 


Curry: Development of SIS 


2.90 


3.08 


Faust: SIS and Management Model 


2.56 


3.00 
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EVALUATION PLAN 

Management Training Program: 
Using Information for Decision Making 

August 21-25, 1972 
Purposes of Evaluation 

!• To disclose specific needs for post-program inservice training 
of administrators by indicating deficiencies in the accomplish- 
ment of program objectives. 

2. To assess the extent to which principals accept and understand 
the School Information System (SIS). 

3. To suggest program modi5;icatlons that are likely to improve 
the quality of the program as it is replicated for other 
audiences. 

A. To provide adequate process evaluation to insure that any con- 
current program modifications that are crucial will be made 
known to the program administrators. 

Instruments and Techniques 

1. Product Instruments 

a. Participants' ratings (pout only): Current level of under* 
standing! increase of level of understanding, worthwhil.eness 
of program components. 

b. Concept Test Cpre and post): Checklists, multiple-choic^e. 
true-false. 

c. Test simulation (pre and post): Multiple-choice and rating 
questions based on selected data for hypothetical school. 

2. Process Techniques: 

A. Interaction with evaluators: Evaluators listen and question 

at coffee breaks, 
b. Suggestion box: Written comnents may be submitted anytime* 
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Subgoals and Objectives 

1# To provide principals an opportunity ^:,o review and apply 1971-^72 
SIS data to specific task situations* 

a. All principals attending the training program will partici- 
pate in the application of a task situation to their 1971-72 
SIS reports. 

b. On the participants* rating Instrument, this activity will 
rank among the three program components seen as most useful. 

2. To assist principals in acquiring a functional knowledge of S1S« 
a. On a checklist of real and fictitious variables on the concept 
testt the number correctly identified as those in SIS will 
show si>me increase from pre to post test. Further, the number 
correctly identified by individual participants will increase 
for at least 73% of the respondents. 
b« Given a checklist of questions thai one might try to answer 
with SIS data, participants will be more successful on the 
post test than on the pre test, in selecting those that can 
actually be answered. Increase in the mean and Improvement 
for 73Z of the participants will be used as criteria, 
c* Participants* ratings of the program components related to 
functional knowledge of SIS will yield a tsean at or above 
the mid-point of the scale. 
To assist the principals in Che use of SIS data for d^<:jl8lon making 
relating to goal setting and problem identif ication« 
a« In the test simulation, there will be an increai^e from pre to 
post test in the mean number of correct responses to items 
involving the use of survey data In goal setting. 
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b. In the test simulation, participants* rating of five equally 
valued goals on the basis of a comparison between hypotheti- 
cal 5>chool data and clty-wlde averages will show closer 
agreement with Judges* ratings on the post test than on the 
pre test. 

c« On the concept test» there will be an Increase from pre to 
post test In the mean number of correct responses to Items 
concerned with various needs Identification techniques. 

d. Participants* ratings of program components related to goal 
setting and problem identification will yield a mean ^t or 
above the mid-point of the scale. 

To assist principals kt the utiligation of SIS data in program 

evaluation. 

a. In the test simulation, there will be an increase from pre 
Co post test in the mean number of correct responses to items 
concerned with evaluating a program of non-gradedness baaed 
on hypothetical school data. 

b> On the concept test* there will be an increase from pre to 
post test in the mean number of correct responses to items 
concerned with the role of program evaluation in local school 
program development. 

c. Participants' ratings of program components concerned with 
program evaluation will yield a maan at or atove the mid* 
point of the scale. 

To assist principals in the interpretation and use of the SCudenCt 
Teacher and Parent Surveys, 
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a. In the test aimulation there will be increase from pre 
to post test in the mean number of correct responses to 
items concerned with the use of survey data in goal setting. 

b. In the test simulation, tht.'^re will be an increase from pre 

to post test in the mean number of correct responses to items 
concerned with the use of survey data in evaluating a program 
of non-gradedness. 

c. Oii the concept test, there wl^l be an increase from pre to 
post test in the mean number of correct responses to items 
concerned with the use of survey data. 

d. Participants' ratings of program components concerned with 
the use of survey data will yield a meaa at or above the 
mid^^point of the scale* 

To assist principals in communicating inforaation to staff, students 
£^nd the public. 

a« Participants* ratings of progr&iQ components concerned with 
communicating information will yield a mean at or above 
the mid-pQint of the scale. 

b. At the cloae of the training program, participants, on the 
average, will rate their current level of understanding of 
communication techniques suited to staff, students, parents 
and other cooanunity members as at least adequate for present 
purposes. 

c. Participants* ratings of their increai:i^e of understanding of 
communication techniques will yield a inwean equal to or greater 
than the minimum predicted mean for a measureable increase. 
The prediction formula will be derived from the regression of 
the ratings of increased understanding, on pre-post content 
test differences in objectives 2 through S. 
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To provide knowledge about the nature and q^ialities of decisions 
aad information. 

a« P4;rticipants' ratings ef program components related to deci-> 
stions and information will yield a mean at or above the 
mid-^point of Che scale. 

b. At the close of the training program, participants « on the 
average, will rate thf^ir current level of understanding of 
the nature and qualities of decisions and information as at 
least adequate for presev\t purposes. 

c. Participants' racings of their increase of understanding of 
the nature and qualities of decisions and information will 
yie3.d a mean equal to or greater than the minimum predicted 
Oii^dn for a measurable increase. 

To show the relation between SIS reports and accountability. 

a. Participants* ratings of program components concerned with 
accountability will yield a mean at or above the mld«*point 
of the scale, 

b. At the close of the training program, participants, on the 
average, will rate their current level of undcrstaadlng of 
accountability as at least adequate for present purposes. 

c. Participants' ratings uf their increase of understanding of 
accountability will yield a mean equal to or greater than 
the minimum predicted mean for a measurable increase. 
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U. Scbeoa 

INSTKUHENTS AMD TECHNIQUES 



Objec- 
tives 


Ratings 
la 


Concept Test 
lb 


lesL 
Simulation 

Ic 


Evaluation 
2a 


suggestion 
Uox 

2b 


la 








/ 


/ 


lb 


/ 










2a 




/ 








2b 




/ 








2c 


✓ 










3a 






/ 






3b 






/ 






3c 




/ 








3d 


✓ 










Aa 






/ 






Ab 




/ 








Ac 


/ 










5a 






/ 






ib 






/ 






5c 




/ 








5d 


/ 










6a 


/ 












/ 










be 


/ 










7a 


/ 










7b 


/ 










7c 


/ 










ita 


/ 










t?b 


/ 










6c 


/ 
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Evaluation Instruments 
USING INFORMATION FOR DECISION HMCINC 



Identification Uat^ 

Part A 
Test Sinulation 

Accompanying this instrument are six sheets of data for GansM Educational Park. 
Three of these (green sheets) are for the 1970-71 school year* and three (pink sheets) 
are for the 1971-72 school year* Thea^e six sheets provide the dcta for this test 
simulation. 

1. Using only the 1970'*71 data (green sheets), rank the five goals listed below 
in terms of priority. Designate the top-priority goal as 1, etc. Assume that 
all five Q^oals are, of themselves, equally valued t 

a« Improved school-community relations 

b. Improved staff morale 

c. Improved student attitudes 

d. Improved reading achievement, primary grades 

e. Improved reading achievement, junior high 



2. Using only the 1970-71 data (green sheets), ansvrer the following items by 

marking an X through T if the statement is true, and through F if the statement 
is false. 

In general. Gamma parents have better attitudes toward school than 
the students have* 

For the most part^ Gamma students seem to be achieving below 
national test norms. 

Attitudes as measured on the Parent Survey seem consistent with 
other indicators of how Gamma parents feel about school. 

If pupil/ teacher ratio is an indicall;lon of the general working 
conditions at Gamma, the teachers seem to have an accurate percep- 
tion of this factor. 

Of the three groups surveyed. Gamma teachers seem to have the most 
favorable attitudes. 



T X 

X F c. 

X F d. 

T X e. 
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At the insistence of several coBbnunlty groups^ a program of nongraded instruc 
tlon was begun at Gamma In 197l-*72. This program was Initiated at the primary 
level with emphasis on reading. Using both the 1970--71 and the 1971-72 data, 
answer the following items about the effectiveness of this program. Mark an 
X through T if the statement is true and through F if the statemant is false. 

The data provided offer no way of Judging iiow primary children 
felt about the programs 

There is some evidence that the program hai;S a positive effect on 
reading achievement* 

Parents seem to have been less involved in school affairs under 
the nongraded system. 

For the primary students themselves^ the program seems to have 
had no negative effects. 



F e. 



Gamma's principal shcjl4 emphasize the successful aspects of the 
program to his comDtt5nity. 



" ESEA TITLE Hi 

CINCINNATI PUBLIC SCHOOL INFORMATION SYSTEM 
I DIVISION OF PROGRAM RESEARCH A DESIGN 

\j?o) GAMMA EDUCATIONAL PARK VARIABLE PRINTOUT 

1971-72 SCHOOL YEAR 



YOUR 


VARIABLE 


UIREC- 


YOUR 


ALL 


OKI T ICAL 


SCHOOL 




i\m 


SCHOOL 


SCHOOL 


AKEA 


UNIT - 

W 1 1 1 ( j 




OF 


UNI T 


UNI TS 




4UMBLK 




VARIA- 


VALUE 






MLUt 




BLE 










ABSENCE AND ATTENDANCE 










i.OO 


GK. 1 AVG DAILY ABSENCE 


/ 

\ " / 


3.4lit 


8.39St 


t>.00$ TO 1 1 . 


i.UO 


GK.2 AVG DAILY ABSENCE 


{-) 


2.96^ 


7.02'^ 


i.99% TO 1 1 .2'J% 


3.00 


GR.3 AVG DAILY ABSENCE 


I') 


2.84J1 


7.17$ 


l.b2% 70 10. 72$ 


7.00 


GH.4 AVG DAILY ABSENCE 


(-) 


6.73ji 


l.tbi 


3.8bS6 TO 1 1 .4t>$ 


1 .00 


bn , -> r.»Vb Un t LT noocnUC. 




ft QS't 


7 34^ 


\ 1 TO 11 bil 


7 ,00 


GH.b AVG DAILY ABSENCE 


{-) 


6.025t 


7 . 


2.58$ TO 12.14$ 


M 00 


GK.7 AVG DAILY ABSENCE 


(-) 


13. 125b 




7.U!>$ TO iy.67$ 


d'b . UU 


/^i 1 Alio JiA J 1 V A LjC L Ki/ ''L' 

GK.o AVG DAILY AbbtNUt 






1 h 1 ^1*11 




M .00 


W.^J AVG DAILY ABSENCE 


( -) 


l!;.41;5f 


it>.y3$ 


6.b8'^ 10 


U .00 


Q<.IO AVG DAILY ABbtNLt 




II \ 7 7 *i[ 


1 1 a iCU p 


0«UU^ lU ^0,^H^ 


i7,00 


GR.I 1 AVG DAILY ABSENCE 


(-) . 


1 4 . 36^ 


l^.5l?t 


8.91$ TO 22. 11$ 




GR.I2 AVG DAILY ABSENCE 


(-) 


8.983S 


9.6455 


4.84$ TO 14.44$ 




ALAULMIC ACHIEVEMENT 


* 










OR. 5 READING SUBTEST 




(GRADE 


EQUIVALENT) 






lO;^ OF STUDENTS AT OR BELOW 




1 .70 


1 .80 


1.00 TO 2.b0 




2% OF STUDENTS AT OR BELOW 




2.30 


2.30 


1.30 TO 3.30 




!)0:{ OF STUDENTS AT OR BELOW 


{+) 


2.80 


2.80 


1 ,60 TO 4.00 




J Op Ur blUDLNIo Al UK DtLUn 








9 00 TO 5 00 




yU/o Ur blUDuNIb Ml UK buLUn 






A 40 


7 40 TO 6 40 




GK.3 ARITHMETIC COMPUTATION 












\Qi OF STUDENTS AT OR BELOW 




1 .70 


2.10 


1.20 TO 3.00 




Ibi OF STUDENTS AT OR BELOW 


( + ) 


2.30 


2.60 


i.ijO TO 3.70 




'jQi OF IjTUDENTS at OR BELOW 


(+) 


2 .60 


3.00 


1 , /O TO 4 .30 




/ J/j Ur olUDtl'iij n 1 UK UtL'Jn 


( 4-) 
\^ I 




4 UO 


'J 40 TO b 60 




V0> Ur blUUtNiJ pi Uf< bt.LUn 




H . UU 




V <%n Til 40 




GR.O RLADING SUt'fEST 












10'^ OF STUDENTS AT OK UtLOW , 


(f ) 


3.00 


3.10 


1 .60 TO 4.60 




ryp Oi SIUDLNTS Al UU BLLOW 


(■»-> 


4.10 


4. 10 


2.10 TO 6.10 




•riA. (A MUDLNlb Al UK ItLLUW 


( + ) 


'j.UO 


'J.IO 


2.80 TO 7.40 




01 lilUDLNTS Al UK BLLOW 


( + ) 


0.40 


b.'jO 


3.60 10 9.40 




90% OF STUDENTS AT OR ULLOW 


( + ) 


8.00 


8.20 


4,60 ro 1 1 .80 




GR.b ARITHMEVIC COMPUTATION 












1056 OF STUDENTS AT OR BELOW 


{+J 


4. 10 


4.30 


2.50 TO 6. 10 




2V; OF GTUULNTS AT OR BLLOW 


( + ) 


4.80 


4.90 


2.70 TO 7. 10 




'Miu OF l,lUDtNT'j Al OH BLLOW 


{ + ) 


'j.bO 


b./O 


3.20 TO 8.20 




)Vl> OF blUDLNTS AT OR BLLOW 


t + ) 


b.70 


b.OO 


3.70 TO 9.90 
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yu; OF blUUENTS AT OK BLLOW 


{+) . 


6.40 


B.50 


4.80 TO 12.20 



^UoK VAHIABLL 
VALUL 

GR.8 READING SUBTtST 

10* OF STUUtNTS AT OR BhLOW 

2% OF STUDENTS AT OR BELOW 

'jQi OF STUDENTS AT OR BELOW 

7b;i OF STUDENTS AT OR BELOW 

90>b OF STUDENTS AT OR BELOW 

GK.8 MATH COMPUTATION 

lO'yb OF STUDENTS AT OR BELOW 

2'^$ OF STUDENTS AT OR BELOW 

hO'h OF STUDENTS AT OR BELOW 

7t)^ OF STUDENTS Al OR BELOW 

OF STUDENTS AT OR BELOW 

ACADEMIC APTITUDE 

HJHLMANN-ANDERSON - GK.3 

10'^ OF STUDENTS AT OR BELOW 

/'Jh OF STl'DLNTS AT OK BELOW 

or SrUDENTS at ok BELOW 

/'j'/6 Of bfUDLNTS A1 OK BELOW 

yU'>b UK srUDENlS Af OK BELOW 

LORGE-THORNDIKE - GR.6 

10* OF STUDENTS AT OR BELOW 

2bi OF STUDENTS AT OR BELOW 

bCi OF STUDENTS AT OR BELOW 

1% OF STUDENTS AT OR BELOW 

90* OF STUDENTS AT OR BELOW - 



33- 

DIREC- YOUR ALL CRITICAL 

TION SCHUOE SCHOOL AREA 
OF UNIT UNITS 

VARIA- VALUE 
BLE 



(GRADE EQUIVALENT) 



/ 1 \ 


3. 70 


3.00 


0,70 


TO 


0.')0 


{+) 


4.30 


4.40 


1 .20 


TO 


7.(.U 




h no 




y QH 


i \J 


CJ '.1 1 
7 . A) 


(+) 


8.70 


8./0 




iu 




(+) 


9.b0 


9.00 


(j.20 


TO 


13. Uu 


1+ ) 


4 ,00 


4 .00 


1 . 10 


T /-V 

TO 


0.^0 


1 + ) 


4 , 70 


4 .80 


1 . 70 


TO 


7/M) 


1+ J 


0,30 


b.30 


3 . 1 U 


ro 




( + ) 


b. 10 


8.10 


4.50 


TO 


i" 1 .(AJ 


(••■) 


9,70 


y 70 


ii SO 


ro 


1 'i 1 { ) 




{ 1 .0- 


LEVEL) 








(>) 


79.84 


78. 3U 


4b. 12 


lU 


1 1 1 


(+) 


86.00 


00.06 


49. / 8 


10 


1 // . '^4 


( + ) 


97.07 


9 'J. 87 


'Jb.44 


10 


1 ^f) 


( + ) 


108.92 


10/. 44 


62.87 


10 


1 W . u 1 


(+) 


123.23 


118.1/ 


69.40 


10 




(+) 


77.13 


76.43 


42.66 


TO 


1 10. ?0 


(+) 


86.03 


84.73 


47.96 


TO 




( + ) 


96.26 


94.30 ■ 


53.35 


10 




( + ) 


108.47 


105.74 


60. 19 


TO 


1 M . '/') 


(+) 


120.39 


1 17.73 


67. 19 


TO 


108.2/ 



SCHOOL & COLLEGE APTITUDE 



TEST - GR.9 - TOTAL TEST 




(PERCENT 


ILLS) 




to* OF STUDENTS AT OR BELOW 


(+) 


7.00 


3.00 


1 .00 TO 22.00 


2b% OF STUDENTS AT OR BELOW 


( + ) 


12.00 


7.00 


2.00 TO 33.00 


t>0>, OP STUDENTS AT OK BELOW 


(+) 


38.00 


21 .00 


3.00 TO 54.00 


."Ji 0^ oIUDENTS Al OK BELOW 


(+) 


64.00 


48.00 


7.00 TO 89.00 


I'Cio OF 'jTUDENTS Al OK BELOW 


(+) 


88.00 


80.00 


37.00 TO 99.00 


i"A MLMBLRSHIP 


(+) 


20.41* 


35.78* 


8.19* 10 65. V/* 


VOTING 'FOR' LEVY 


(+) 


29.10* 


29.58* 


1 .9b* TO 'J/.20* 


ATTITUDE (PARENT SURVEY) 










PARENTS RESPONDING 


( + ) 


59.63* 


53.40* 


31 .98* TO 74.82* 


SCHOOL ATMOSPHERE FACTOR 


( + ) 


62.19* 


59.13* 


37.71* TO 80.55* 


SCHOOL PROGRAM QUALITY FACTOR 


( + ) 


76.43* 


54.89* 


33.47* TO 76.31* 


SCHOOL PUPIL RELATIONS FACTOR 


(+) 


66.51* 


62.48* 


41 .06* TO b3.90* 


EDUCAnONAL ISSUES FACTOR 


(+) 


58.35* 


56.93* 


35.51* TO 78.35* 


PARENT PARTICIPATION FACTOR 


(+) 


54.20* 


51 .40* 


29.98* TO 72.02* 
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VAKIAliLL 



STUDENT ATTITUDE {GR.6) 

ACADEMIC CONFIDENCE FACTOR 
ATTITUDE TOWARD SCHOOL, FACTOR 

STUDENT ATTITUDE (GR..9) 

ACADEMIC CONFIDENCE FACTOR 
ATTITUDE TOWARD SCHOOL FACTOR 



•3A- 
D I REC- 
TI ON 
OF 
VARIA- 
BLE 



(+) 



( + } 
(+) 



YOUR 
SCHOOL 

UN II 
VALUE 



77.84$ 
63. 1 4^ 



69,\i% 
63. 14'^ 



ALL 
SCHOOL 
UNITS 



51 . 15$ 
44.42$ 



CRITICAL 
AREA 



TO UL.bAi 
32.0 7$ TO ti/.tJi 



31 .29$ TO / I . J\ % 
27.47$ TO 01 . yii 



STUDENT ATTITUDE (GR. I2J 

ACADEMIC CONFIDENCE FACTOR 
AITITUDL TOWARD SCHOOL FACTOR 



( + ) 84.73$ b2.2t% 3G.'i2$ 10 ii/.uUX 

(+) 75.39$ 52.30$ 32.59$ 10 //.U\i 



ATTITUDE (TEACHER SURVEY) 



ILACHERS RESPONDING 


( + ) 


81 .95$ 


81 


.32$ 


54.94$ 


rc 






STAFF WRALE FACTOR 


( + ) 


4.73 


4 


.01 


3.05 


10 


6 . 


1 / 


SPECIAL EDUCATION NEEDS FACTOR 


(+) 


2.96 


2 


.83 


1 .67 


TO 


3. 




PUPIL CHARACTERISTICS FACTOR 


( + ) 


4.42 


4 


.42 


2.90 


TO 


5 . 




WORKING CONDITIONS FACTOR 


(+) 


3.19 


4 


.39 


2.80 


10 


5 . 




PHYSICAL RESOURCES FACTOR 


( + ) 


4.73 


4 


.42 


2.94 


10 


J • 




COMMUNITY & PARENT CON 1 ACTS FACTOR 


C+) 


4.83 


4 


.27 


2.79 


TO 


1> , 


J') 


OPENNESS TO INNOVATION FACTOR 


(+) 


4.76 


4 


.41 


2.86 


TO 




Mb 


PUPIL/TEACHER RATIO 


















OVERALL SCHOOL 


( ) 


36. GO/ONE 


27.00/ONE 


22.46 


TO 


51 
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ESEA TITLE III' 
CINCINNATI PUBLIC SCHOOL INFORMATION SYSTEM 
DIVISION OF PROGR/AM RESEARCH i DESIGN! 

ty7o) Ghim EDUCATIONAL PARK VARIABLE PRINTOUT 

1970-71 SCHOOL YEAR 
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VARIABLE 


D: REC- 


YOUR 


ALL 


CRIT ICAL 


'J ■ m 




TI ON 


SCHOOL 


SCHOOL 


AREA 






t\r 
Ur 




UN 1 1 b 










varia- 


VALUE 








VALUE 




ble 












ABSENCE AND ATTENDANCE 












7.00 


GR.I AVG DAILY ABSENCE 


(-) 


6.24^ 


8.39i^ 


b.ooli rc 


1 1 . Ibi 


0.00 


GR.2 AVG DAILY ABSENCE 


(-) 




7.62'^ 


3.99^ TC 


1 1 .2^% 


7.(X. 


GR.3 AVG DAILY ABSENCE 






7 J 7?; 


5.62% ro 


10. 72% 


7.00 


r.R:4 AVG DAILY ABSENCE 




6.84^ 


7.65JS 


3.85^ TO 


1 1 .4'/^ 


/.oo 


GR.i AVG DAILY ABSENCE 


(-) 


6.53^ 




3. 15^ TO 


1 ! .bip 


/ ♦ Uv 


bK.O AVb UA 1 LT AbbtNut 






/ . 3b^i 


Z , Do1b \ L 






GR.7 AVG DAILY ABSENCE 


(-) 


13.01? 


13.76^ 


1,00% 10 




^6M0 


'ifi.B /^VG DAILY ABSENCE 


(-) 


14. 86^ 


1 5. tb^ 


9. \ \\% TO 


71.1 4 'a 


2 \ .00 


GR.9 AVG DAILY ABSENCE 


(-) 


15. 25^ 


15.93^ 


b b8i 10 






Gr^.iO AVG DAILY ABStNCE 


(-) 


16.80^ 


1 7 . 20i 


8.06? rc 


2b. 54% 


ici . UO 


GR. II AVG DAILY ABSENCE 


(-) 


14. 95^ 




8.91? TO 


22. j \% 


c .J , 00 


bK , 1 / Avb UAILT AbotiMut 




8.435^ 




4.8456 TO 


\A.AA% 




ACADEM5C ACHIEVEMENT 




(GRADE EQUIVALENT) 








GR.3 READING SUBTEST 














lOi OF STUDENTS AT OR BELOW 


( + ) 


1 .60 


1 .80 


1 .00 TO 


2.50 




OF STUDLNTS AT UR BELOW 


( + ) 


2.10 


.2.30 


1 .30 TO 


3. 30 




'jO% of students at OR BELOW 


( + ) 


2.bO 


2.80 


1 fiO TO 


4 on 




/P/b OF bTUUbNTb AT UR BELOW 


v + ) 


3.30 


3.50 


2 00 TO 


S 00 




90% OF -iTUDLNlS AT OR BELOW 


( + ) 


4.10 


4.40 


7 40 TO 


6 40 




GH.:i ARlTHMtHC COMPUTATION 














lOi OF STUDENTS AT OR BELOW 


( + ) 


2.10 


2. 10 


1 . 20 TO 


3.00 




Zb% OF STUDENTS AT OR BELOW 


( + ) 


2. 60 


2.60 


1 . 50 TO 


3. 70 




'3U5i OF STUDENTS AT OR BELOW' 


( + ) 


3.00 


3.00 


1 . 70 TO 


4 . 30 ■ 




< J/u Or blJULNIb Al OR BELOW 


It i 


4.10 


4.00 


2.40 TO 


5 .60 




9G'i OF STUDENTS AT OR BELOW 


( + ) 


4.60 


4.50 


2.60 TO 


b .40 




GR.b HEADING SUBTEST 














\0% OF Sri'.jL\'T5 M OR BELOW 


( + ) 


3.00 


3. 10 


1 , 60 TO 


4.bU 




2bi OF blUULNTS AT OR BELOW 


( + ) 


4.00 


4.10 


2. 10 TO 


6. 10 




OF SlUULNTS AT OR BELOW 


1 + ) 


b. 10 


i). 10 


2.80 TO 


7.40 




7;)"; OF STUDENTS AT OR BELOW 


( + ) 


6.40 


6.50 


3.60 TO 


9.40 




90% OF STUDENTS AT OR BELOW 


( + ). 


8.10 


8.20 


4.60 TO 


1 1 .80 




GR.b ARITHMEnc COMPUTATION 














\o% or IjIudents ai or be low 


(^) 


4.10 


4.30 


2.50 TO 


6.10 




/•y}> OF SlUULNlS AI OR ULLOW 


( + ) 


4.80 


4,90 


2.70 TO 


7.10 




'jQi Of STUULNIS Al OH ULLOW 


U) 


!3.50 


5.70 


3.20 TO 


8.20 




/'>'X Of i.lUUl.NlS Al OR IM LOW 


(+) 


b.70 


b.80 


3.70 TO 


9.90 




'm. or :ilUULNTS Al OR ULLOW 


(+) 


8.40 


8.50 


4.80 TO 


12.20 



-JO- 



ALL CKMltAu 
buMUOL AHLA 
UNI IS 



Gf^.d RtAUING SUBTtST (GRADt EQUIVALENT) 



10* OF 


'oIUUtNTS 


AT 


Oh 


uLlOW 


(O 


3.70 


3.00 


0.70 


TO 


O.bO 


2b% OF 


STUDENTS 


AT 


OR 


bLLOrt 


( + ) 


4.40 


4. 40 


\.2Q 


TO 


7 .60 


'jQi OF 


STUULNT5 


AT 


OR 


lit LOW 


C + J 


6.20 


6. 10 


2.90 


TO 


9. 30 


uf- 


bTUULNTS 


AT 


UK 


tit LOW 


( + ) 


a.yu 


8.70 


b.30 


TO 


1 2 . 1 U 


yU> OF 


STUDLNTS 


AT 


OR 


btLOW 


( + ) 


9.90 


9.60 


0.20 


TO 


I 3 . 00 


Q-S.d MATH COMPUTATION 
















iU'Jt OF 


5TUDLNTS 


Al 


OR 


bLLOW 


1 + ) 


4.00 


4.00 


t . 10 


TO 


0.90 


I'ii OF 


IjTUOLNTS 


AT 


OR 


btLOw 


( + ) 


4 .bO 


4.ao 


1 .70 


TO 


7.90 


bO'ji OF 


blUOLNTS 


AT 


OK 


lit LOW 


(+) 


0.20 


0.30 


3. !0 


TO 


9.'j0 


rjp OF 


blUOLNTS 


AT 


OR 


bELOrt 


( + J 


d.OO 


8. 10 


4.00 


TO 


II .00 


'jo:£ OF 


STUDLNTS 


AT 


OR 


LSLLOW 


( + ) 


9.00 


9.70 


0.30 


TO 


13.10 



? ^ijK VAKIAdLt 



UIRLC- YOUR 

T ION SIHCX3L 

cr UNfT 

VAHIA- VALUt 
BLt 



ACAUtMlC APTITUDL 



IOA> 


OF 


:>TUDtNTS 


AT 


OR 


BtLOW 


( + ) 


BO. 1 3 


78.30 


4b. 12 


TO 


1 1 1 .48 




OF 


STUDENTS 


AT 


OR 


UELOW 


( + ) 


88 . 20 


86.00 


49. 78 


TO 


1 22 . S4 




OF 


bTUDLNTS 


AT 


OR 


tit LOW 


( + ) 


96. 10 


9b. 87 


bb,44 


TO 


I 'lO . HI 


7 bit 


OF 


blUUENTS 


AT 


OR 


BtLOW 


( + J 


1 10.21 


107.44 


02.87 


TO 


1 b2.ul 


905i 


OF 


STUDLNTS 


AT 


OR 


tit LOW 


( + ) 


124.9b 


118.17 


69.40 


lu 


Itj0.'i4 



LORGL-lHOKrjUIKE - GR,6 



I0> OF 


SlUDtNTS 


AT 


OR 


BtLOW 


( + ) 


76.97 


76.43 


42.66 


TO 


1 10 


.20 


2 b'* OF 


STUDtNTS 


AT 


OR 


BtLOW 


( + ) 


8b. 24 


84.73 


47.96 


TO 


121 


.bO 


bO;i OF 


STUDENTS 


AT 


OR 


BELOW 


(+J 


90. &I 


94.30 


b3.3b 


TO 


13b 


.2'' 


7b5< OF 


STUDLNTS 


AT 


OR 


BtLOW 


(+) 


107.21 


105.74 


00. 19 


TO 


Ibl 


. 2'i 


yo> uF 


SlUOLNTS 


AT 


OR 


BtLOW 


t + ) 


1 I9.'»^ 


117.73 


07. 19 


TO 


lt)8 


.2/ 



SlUOOL & COLLEGE APTITUDE 

TEST - aR.9 - TOTAL TEST (HEi -:.ENT I EES ) 



!0^ OF STUDENTS AT OR BELOW 


1+) 


6.00 


3.00 


1.00 TO 22.00 


2b^ -Ji" STUDENTS AT OR BELOW 


( + ) 


-12.00 


7.00 


2.00 TO 33.00 


bO^ OF STUDENTS AT OR BtLOW 


( + ) 


'37.00 


21 .00 


3.00 TO 54.00 


;'>i ur SVUDENTS AT OR BELOW 


( + ) 


62.00 


48.00 


7.00 TO b'J.OO 


90; Or STUDENTS AT OR BtLOW 


{ + ) 


88.00 


80.00 


37.00 TO 99.00 


PTA MLMBERSHtP 


(♦) 


7 .675t 


" 3b. 78$ 


8.19$ rO bV3/$ 


Vl.''!;.G 'FOR* LEVY 


( + ) 


l0.23St 


29.bO$ 


I .90$ ro 'j1 ,A>i 


AIinOuL Ct'AKLNl SURVEY j 










1 ARENTS RESPONDING 


t + ) 


30.845t 


53.40$ 


3t.9B$ TO 74.82$ 


jUHO' '. ATf-VDSPHERE i^,.CTOH 


( + ) 


31 .62$ 


59,13$ 


37.71$ TO 80.bb$ 


SCtiu^L PROGl^M QUALITY fACTOR 


( + ) 


29.83* 


54.89$ 


33.47$ TO 70.31$ 


SCHCXJL PUPIL REALTIONS FACTOR 


f. + ) 


40,925t 


62.48$ 


4). 06$ TO 83,90$ 


EDUCATIONAL ISSUES FACTOR 


( + ) 


30,13$ 


56.93$ 


35.51$ TO 78 yyk 


PARENT PARTICIPATION FACTOR 


( + ) 


26.84$ 


51 .40$ 


29.98$ TO 72. il2$ 
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VARI AuLt 



STUDENT ATTITUDE (GH.G) 

ACADEMIC CONFIDENCE FACTOR 
ATTITUDE TOWAKU SCHOOL FACTOR 



UIRLC- 
r !0N 
OF 

VARIA- 
BLE 



{ + ) 
( + ) 



YUOH 
SCHOOL 

UNI T 
VALUE 



76.27$ 
82.39$ 



ALL 
SCHOOL 
UN I T S 



b7.77j; 



CRI T ICAL 
AKLA 



32.48$ ro d0.o4£ 
32.b7$ TO bi'.b/i. 



STUDENT ATT ITUDE {GR.9) 

ACADEMIC CONFIDENCE FACTOR ( + ) 67.43$ 51.11?$ 31.29$ TO n.j\l 

ATTITUDE TOWARD SCHOOL FACTOR (+) 60.96$ 44.42$ 27.47$ TO M.^/i 

STUDENT ATT ITuDE (GR. 12) 

ACADEMIC CONFIDENCE FACTOR ( + ) 82.64$ 62.26$ 36.92$ TO til .bOi, 

ATTITUDE TOWAKU SCHOOL FACTOR ( + ) 73.72$ 52.30$ 32.59$ TO 72.UI>. 



All ITUDE (TEACHER SURVEY) 



ILACHERS HESFONDING 


( + ) 


74. 


ciZ% 


til ,32$ 


54.94$ 


10 ' 


^9. 


STAFF MORALE FACTOR 


1 + ) 


4. 


! J 


4 .bl 


3.05 


10 


0 


. 1 J 


SPECIAL EDUCATION NEEDS FACTOR 


U) 


2. 


7l 


2.83 


1 .67 


TO 


3 


. i'i 


PUPIL CHAKACTtRISTICS FACTOR 


(■»■) 


4 , 


33 


4.42 


2.90 


ro 


5 


.94 


WORKING CONDITIONS FACTOR 


( + ) 


2. 


01 


4 .39 


2. 60 


TO 


5 


.9H 


RiYSICAL RESOURCES FACTOR 


{ + ) 


3. 


94 


4.42 


2.94 


TO 


5 


.90 


COMMUNITY 4 PARENT CONTACTS FACTOR 


{+ ) 


3. 


til 


4.27 


2.79 


TO 


5 


. /5 


OPENNESS TO INNOVATION FACTOR 


{ + ) 


4 . 


06 


4.4 1 


2.80 


TO 


5 


.90 



PUPIL/ TEACHER RATIO 

OVEf^LL SCH(X)L { ) 36. GO/ONE 27. GO/ONE 22.48 TO 31.52 
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Identiflcacion Date 

Part B 
Content Test 

Answer the questions c\i this instrument on the b^sls af your knowledge of Che 
School Infornatiou System* needs Identification techniques^ and program evaluation 
techniques. 

1. Check all the items ii: the list below that represent variables Included in 
the School Information System. 

Percentage of Community Residents _ Number of Students Lllglble for 

with College Degrees Special Education 

y Number of Psychological Referrals Number of Students Receiving 

Subsidized Lunches 

Number of Students Receiving Public V Percentage of Women on Staf 

Dental Car^ 

Number of Transfers-Out }/ Percentage of Felony Arrests 

>/ Number of Persons per Total Acre— Age of School Building 

7U Census 



2. Check all the questions in the list below that can be answer with data from the 
School information System. 

Uh9;t's the average attendance at PTA meetings in my «chool7 

How do the mott intelligent otudents in my scfiool compare in Math achievement 
with those in other i^chools? 

y In terms of certif I'c&tiont how well qualified are my teachers* compared to 
those of previoui years? 

What is the ratio of black to white patents in my community? 

^ liow Oiany students in my school live in foster homes? 

Hov do teachers in my school feel abovit educational innovation? 
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J. Ansv/er the following ivtma by marking an X through T If tha atatamant la tru^ 
and through F If the atatamant la falae. 

yl^ F a. £ven when the total achool coDnnunlty haa bean Involved In goal 

development 9 aupport for the goalie will be Increaaed by data that 
substantiate related needs. 

X F b* Goal statements should specify the target group » the thing to be 
done* and the amount of change desired. 

T X c» Heeds assessment should usually be concerned with problems » not 
with successea^. 

T X Important reason for Involving the community In goal setting 

Is to relieve the principal of responsibility for making decisions. 

T X e. In working with the community tc evaluate the school program* the 

principal should preaent complete Information to all Interested groups. 

X P 7he trust level between the school end its critics is Important in 

deciding how to use evaluative information. 

^ F g. SIS exceptions reporta may identify a scboo.\*s strengths and weak- 
nesses, as well as a^libis for poor per£orman';e. 

T yC h» Program evaluation should concern Itself with the goals of the program 

and not ulth unexpected outcomes. 

T y( Because surveys give subjective information* their results usually 

should not be included in program evaluation. 

y( F j. Surveys often provide information about attitudes that could not be 
obtained in any other way. 

X F One important uae of surveya is to detect inconaistencles of view- 

points f^cross groups. 

T X ^« comparison across years ^ SIS surveys are kept 

identical from one year to the next. 



Program HcaearcU 4 Ueaigu 

^ tt 1972 
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Final uay of Pro^rom 



Identification 



Part C 
Participant's Ratings 

Please responc'^ frankly to the followl'Ag items by putting a check (/) in the 
column ^hat reflects your ratings 

1« liValuate each of the following presentations and activities on the basis oC 
the usefiilness o£ what you learned • 

Not A Litcle Fairly Very Indlspen- 
Ist day Useful Useful Useful Useful sable 

Curry: development of SIS 

Waldrip: Accountability 

Exercise in Group Decision Making 



2nd day 

Barbadova: Oata Usage 6 Croup 
Involvement 

Jacobs: Principles of Using 
Information 

Interpretation of SIS ^;^;>orts 
ird day 

Goal Setting Simulation 

Felix: SIS in Program Evaluation 

Faust: SIS and Management Model 

Bollenbacher: Interpreting 
Achievement Uata 

4th day 

Smith: Management Information Syetem 
Panel; What Public Wants to Know 
Salth: Potential of SIS 

3th day 

Varland: Use of Surveys 
Analysis of 1971-72 Rc^yorts 
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1. For each of the following areas, evaluate how ouch your knowledge has increased 
during this workshop and how adequate your current understanding is. Give your 
Judgment of knowledge increase as a rating from 1 (no incre#<tte) to 7 (very large 
increase). Appraise your current understanding by checking (/) one of the three 
columns provided. 



CURRENT UNDERSTANDING 

KNOWLEDGE Adequate Thorough 

INCREASE for and 

(l»no increase, Frobably Present ComplGtciy 

to 7«very large) Inadequate Purposes Adequaio 



a. Your functional knowledge 
of SIS 

b. Your ability to use SIS in 
goal setting and problem 
identification 

c. Your ability to use SIS in 
program evaluation 

d« Your ability to interpret 
and use survey results 

e. Your understanding of 
techniques for communicating 
information 

f. Yousr knowledge of the nature 
and qualities of decisions 
and information 

g. Your understanding of 
accountability 



i^oo^ram Research & Design 
ERIC"' 1972 



86 



APPENDIX C 



Evaluation Report for SIS Training Sessions 



November, 1972 



ERIC 



SUMMATIVE EVALUATION REPORT 
Using Information for Decision Making 



SIS Monocemcnt Training Program 
November, 1972 



CINCIHKA^n PUBLIC ^^CHDOLS 
Divisicm of Progroirt Uc c -^irch ond Do cl^pj 



I 



SUMMATIV12 EVALUATION REPORT " 
Usinc Information for Decision Itoking 

SIS Management fralning Program 
Novem'bcr^ 1972 

INTRODUCTION 

Purpose 

Aim of Report * This report presents the summative evaluation of the 
management training program conducted for Education Center adminictratorc 
and supervisors of the Cincinnati PulDlic Schools by the staff of the School 
Information ^stem (SIS). The information presented here ia intended to 
serve two fundamentt^L purpoees. First; it should provide partlciponlc In Lho 
training. progrc<m ^and other InLcrcsted purnonncl with a concise ycL thorough 
evaluation of the training. Secondly^ the information in this report 
supplements that of the more detailed evaluation of the con^porable program - 
given in August for principals and assistant principals. Ttogeth'jr^ 
these two reports should f\amish the staff of SIS with a coirj>rehenolvc 
assessment of how well the training has accoii^pllshed its cbjeetives. 

Purpose of Evaluation. The detailed evaluation plan devised for 
the August training program specified four purposes for conducting the 
evaluation. These were concerned with disclosing needs for post-program 
inservice training^ assessing acceptance and understanding of SIS; suggcob- 
ing program modifications for future.^ rcplicationn; and providing proc^nc 
ovaluation. 

In adapLlng the original prograjm lo the needs of Education Center 
personnel; the program coordinator and avaluator decided that only the 
first two of these original purposes were appropriate for eva3,uating the 
ERJ[C^v program. ThuS; the two piurposcs that this evaluation fcctcinpted to serve 



were: 

1. To disclose specific needs for poct-progrsun inservicc training 
of administrators and supervisors. 

2. To assess the extent to which principals accept and understand 
the School Information System. 

Plan of Report , This report is organized into five divisions: 
Introduction^ Cognitive Evetluation^ Affective Evaluation, Conc].ucionc, and 
Recommendation. After this introduction has presented the rationales and the 
organization of ihe report, each of the next tvo sections vil]. focus on 
one of the purposes toward which evaluation was addressed. The: second 
division of the report will attempt to identify inservice training needs 
that reveal themselves through responses to the two cognitive instrument:: 
odministered at the beginning and end of this two-doy program. ITicsc 
were the Content Test and the Test Simulation. (Soe August report). 

In the third division of the report the results of on attitude ncal<^ 
adininistered at the conclusion of the pro(jrcu)i will "bo discussed. ITiura: 
rcsxil.ts serve primarily the second porppso of evaluation specif if:d abovc# 
Program Goals 

A threefold program goeO, was set for this workshop; 

This program seeks to provide central -office staff with a greater 
awareness of: (a) the School Information bystem (SIS), (b) how data 
f rom^ SIS can be uned, and (c) the knowledge and atti tudi^s ncccsnory 
to use the system effeetivelj-. 

This goal wac furliicr subdivided Into eight subgoals: 

1. To demonstx^ate the importance of usintj Information for decision mnlclng. 

2. lb provider laiowlcd(jc about the natm^c and rj^ualitlcn of dccisluns and 
inforuiatlon. 

J, IS) dcncivUKv the ]ilntax7 nnd rim«rtf.on of SIG. 

h. To assist central off lee ntaff In acq^uiring o functional Icnowlcdgo 
of 5?TS reports. 

5. To assist the staff in utilizing SIS for decision making related 
to goal setting and problem identification* 
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6. To .shov the rclatlonchip tctvccn SIS rcportc and accountaMllLy. 

7. To assist central office staff in evaluating the needs of local 
schools. 

8. !Ito evaluate the training prograiii. 

COaNITIVE EVALUATION 

Test Simulation 

Goal Sebting o The fircL pujrpoce for evaluatixjg the Edvrcatlon Center 
workshop was to dirrcloco future Inscrvice training needs. To accoii5)lliyli 
this purpose^ the Test Simulation contained true -false itemc reflated to 
tvo major en5)hases of the program: goal settitog and program evolujation. 

Five items "based on hypothetical data vere concerned with matters 
of estatlishixig educational goals. The percentages of respondents 
answering each of the q,uestions correctly on the pre-and poct-tests ore 
shoAm in Tatle 1. 

Tatle 1. Percentogec of Correct Rccponse to Goal Setting Items on Ter;t 
Siraalation, "by Prc-For»t Tests. 



Item Pre 


Test 


PoGt Tcr.t 


In general. Gamma parents have "better abt- 
ituflec toward school than the students hare. 


Ol^J - 


13'f> 


For the most part, Gamma studentc- seem to he 
acliieving telov national test nonns. 




kl 


Attitudes as measured on the Parent Survey 
seem consistent ^d.th other indicatbrs of 
lio\7 Gamma parents feel ahout school. 


82 


55 


If pupil/ tcachei- ratio in on indication 
of the general TOrkii\'5 conditlonr: at 
Gamma, the teachcrr nccm to liavc cm accurate 
prvoeptlon of l\dr. factor* 


Go 


67 


Of the tlu*oe group 0 surveyed. Gamma teacher c 
r.oom to have tlit* mor.t favorahl<* nttHudoc. 


73 
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Interestingly, the percentages of correct responseo decreased on 
four of the five items. In interpreting this fact, however, it is ln^portaat 
to note that an inadvertent error in reproducing the instrument made it 
necessary to hacve tvo separate keys for the post-test. As a result, the 
difficulty of some of the items may have "been greater on the post- than 
on the pre-test. 

Program Evaluation # This same prolDlem of keylug the responses to the 
Test Simulation existed for the five items concerning program evaluation. 
The percentages of correct response to 2^3e items on pre- and post-tests 
are shovn in Ta'ble 2. 

Tabic 2. Percentages of Correct ReBponse to Program Evaluation Items in Te'^t 
Simulation^ by Pre-Post Test, 



Item Pre Test Post Test 



The data provided offer no way of judging how 
primary children felt about the program. 


195^ 


31?J 


There is some evidence that the program had. 
a positive effect on reading achievements 


h9 


53 


Parents seem to have been less involved in 
school affedrs under the nongrodcd syf,tcm. 


h9 


55 


For the primary students themselves, the program 
seeme to have had no negative effects. 


23 


39 


Gamma '5 principal should en^phasize the 
suecass^ful aspects of the program to his 
community* 


56 


0 88 
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la contrast to the goal setting items, all five of the program evaluation 
items showed larger percentages of correct an^^rfl on the post-test. The 
difficulty of these items may have "been affected less "by the trror In 
reproducing the instrument. Or there raj^ht actually have "been a greater 
increase In participants' understanding related to tlUs cognitive area. 
Content Test 

Functional Knovletee. of SIS . The Content Test, also administered "before 
and after the training program, was not dependent on hypothetical data* 
Thus, the difficulty level was identical for "both adninistrations of the 
test. The first page of items on the Content Test was dcoigncd to measure 
participants* knowledge of the School Information System (SIS). It included 
a list of ten variables^ seven real, and three fictitious. Without knowing 
the correct number, respondents were asked to identify those ackuoHy 
contained in SIS. Each item In the list was scored as correctly or 
incorrectly designated. 

On this portion of the Content Test, participants answered an average 
of 4.9 Items correctly on the pre-test and an average of 7-3 on the post* 
test. This increase in the mean number of , correct rasponses sugg^JSts 
that participants* knowledge of the ^stem did increase through the two*- 
day training program. Nevertheless, their post-test responees were 
less correct than those of the participants in the August program, who 
averaged over eight items correct. 

A second section of the Content Tost listed six q^uestion, three of which 
could actually "be answered with SIS data. Again without knowing how 
many, participants were asked to select thoie g^uestions that could 
actually be answered. 

For this part of the test, correct responses 6f participants averaged 
O 2.6 of the six items on the pre-test^ and on the post test. Again 
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there vas an increase^ this time coirsparliig favorably with the results 
of the August vorkshop. 

Goal Settli3g > Of twelve true -false items on the Content Test, four were 
concerned with igader standing the prluciplfes of goal sitting • Again, 
these items were not concerned with hypothectical data, so that pre-post 
tests results may be compared directly. Percentages of correct responses 
to these items are reported in Table 3. 



Table 3. Percentages of Correct Response to Goal Setting Items on Content 
Test^ by Pre-Post Test. 



Item Pre Test Post Test 



Even when the total school community has been 
involved in goal development, support for the 
goals will be increased by data that substantiate 
related needs. 100^ 

Goal statements should specify the target group, 
the thing to be done^ and the amount of change 
desired. 79 89 

Needs assessment should usually be concerned with 

problems, not with successes. ^9 53 

One iiqDortant reason for involving the 
community in goal setting is to relieve the 

principal of responsibility for malcing decisiono. 90^ 96 



Three of the four items ^howod increases from beginning to end of 
program, suggesting that participants' ujideriltanding of this area did, 
in fact, iinproveo 



93?6 
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Program Evaluation ^ An additional foor items from this section of the 
Content Test vere related to program evaluation. The percentages of correct 
responses for these Items are shown Iri. Table k* 

Table k. Percentages of Correct Response to Program Evaluation Items on Content 
Testj by Pre-PtiBt Test. 



Items Pre Test Post Test 



In vorkliig vlth the community to evaluate the 
school prpgram, the principal should present 

complete information to all Interested groups. I85& 1^956 

The trust level between" the school and its 
critics is important in deciding how to use 

evaluative information. Jh 93 



SIS exceptions reports may identify a school's 
strengths and vealoiesses; as well as alibis 

for poor performance. kh 73 

Program evaluation should concern itself with the 
goals of the program And not with unexpccbed 

outcomes. 56 73 



All four items showed li^provement from pre- to post-test. In general^ 
there was a substantial increase in the percentag;e of respondents giving 
correct answers. This result confirms the evidence from the Test Simulation 
that participants did gain in their knowledge of this cognitive area. 

Surveys * The last four Items on the Content Test were related to 
the use of surveys • Although siu^ey use wa\3 nbt adjfltressed as a major area 
for this proj^ram as it was in August , survey data VM Included In the 
information used by partlclptmts in practice oxerclDeD. Ttio correct 
rcnponfic percentage fox* these four items are shown in Table 5* 
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TaMe 5. Percentages of Correct Response to Survey Items on Content Teat, 
by Pre -Post Test, 



Items Pre Test Post Test 



Because surveys give subjective information, their 
results usually should not be included in program 
evaluation- 


67i> 


9% 


Surveys often provide Infoinnatlon about attitudes 
that could no t~be obtained in any other vay. 


56 


87 


One irriportant use of surveys is to detect 
inconsistencies of viewpoints across groups. 


3h 


89 


For the sake of coicparlson across years, SIS 
s\jirveys are kept Identical from one year to 
the next. 


kS 


ho 



Again, all four Items shoved in](provement from pre- to post- test, tdth 
substantial gain on three of the four. This result suggests that the practical 
application of survey data may have been adeq[uate to increase under staaading 
in this area. 

ATOECTIVE EVALUATION 

Opinion Inventory 

Attitudes tovard SIS . An Opinion Inventory (attitude scale) >ras 
adrolni stored at the close of the workshop to measure participants* feelings 
about SIS and the training program. On each of twenty Items, respondenti; 
reflected tholv extent oi^ vigreement or disagreement. Six of those Items 
wore specifically concerned with feelings about the School Information SSystcm. 

Items scores were confuted by assigning a value of f,tve to the most 
fjsvorable response, a value of one to the least favorable, end values of four, 
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three J and tyo to the intermediate responses. 

Por example^ if the statement expressed, a positive attitude, a 
response of strong!;/ agree was given a five-point value, agree four points, 
undecided three points, disagree tvo points, and strongly disagree one point. 
The scale was reversed for statements expressing negative attitudes. 

The scores for the- six items dealing vith attitudes toward SIS ore 
shown in Ta'ble 6. 

Table 6. Item Scores on Opinion Inventory Items Related to Attitudes 
toward SXS» 



Item 


Itiim Mean 




The School Informa'teion ^stem contains useful 
information for school administrators* 


lf.6 




Spendir^g taxpayers* money to accumulate a bank of 
data like SIS is a waste. 


h.k 




SIS printouts do not clearly describe a school. 


3-3 




I don't think SIS data will help mo in making 
acbninistrative decisions. 






I would like to learn more about the School 
Liformation ^stom* 


k.2 




I am eager to begin applying SIS data to my work. 


3-9 





The six item scores averaged h»l, suggesting positive feelings toward the 
School Information ^stem. There should be little need for concentrating 
future efforts on iinproving the attltiudcc of Mucation Center poroo^mel 
fcowards SIS. 

Using EvciLaatlve Data ^ Another six Items on the Qplalon inventory 
concerned attitudes toward the use of evaluative lnformatlon# The ocoreB 
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for these six items are reported in Table 7. 



Table J. Item. Scores on Opinion Inventory Items Bela^ted to Use of 
Evaluative Data. 



Item Item Mean 



Having no data at all is "better than having djata that 

might he misinterpreted* 3.^\ 

I find the concept of accountability tlireatenlng. 

1 don't Imov enough about staticticr; to uce the 

information contained in SIS. 3.6 

The goals of education are too intangible to be 

measured by hard data. 1| .0 

I don't believe there is a need to base educational 
decisions on factual information. U.5 

In general, educational evaluation ccemc vorthlesc 

to me. 1^,6 



Again the item mean indicates positivG feelings on the port of hhn 
participants. Tlius^ there is probably little need for additional concern 
vith feelings In this area* 

Attltxjdes tovard Workshop . Tlae other eight items related to 
participants' opinions about the training program and its content* 
Scores for these items are shovn in Table 8. 
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Tablc 8. Item Scores on Opinion Inventory Items Related to Workshop. 



Item 


Item Mean 


I believe I have a clear understanding of the nature 




of decisions* 


3.9 


SIS data are helpful in evaluating nchool programc. 


If. 2 


3IS data are a valuable means of ascessing educational 




needr^. 


h.l 


I believe I have a gqod vorkinfi Icnovledgc of the School 




Information ^^t.tem. 


3^5 


SIS is helpful to afljiiinistrators ixi goal settirig. 


k.Z 


Tliis workshop has been useful. 


h.3 


I don't think many of tl.\c participants benefitted ftom 




this, voiitshop. 


h.l 


Central office personnel need more training progrcu^is like 




thif3 one. 



Again, the overcll picture is definitely positive. Participants 
appm^ently believed Uiat they had benefitted from the program and felt 
that their understanding of SIS had been improved as a result of tl^c 
Workshop. 

COIICLUSIONS 

The results of the cognitive and affective evaluation Guggest 
several conclusions ab.out the SIS training program for Education Ccaitor . 
persoimel. 

The two-day workshop appears to have achieved success conflporablc to 
that of the August progroia for principals and assistant principals. 
Cognitive instruments adjninlstered before and after the wrkshop 
indicate Imowledge gains among nearly all participants. An attitude 
scale used at the end of the prograa showed highly favorable feelings 
in workshop-related areas. 



1* 
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2f Smallest gains in measured knowledge occurred. In the area of 
goal setting and problera Identification. Possibly because of 
Increased Item difficulty^' post-test percentages of correct rccpoHM 
declined on several Items In this area. 

3t Wo single area emerges from the evaluation results as most iraportont 
for future Insexvlce training* Despite tha decline in the goal Getting 
area; these post-test percentages con5)ared favorably vith those for 
program evaluation; survey usC; and functional knowledge of SI3. 
The approach of the workshop in dealing brief Ij'- ^rlth several major 
ax'eas apparently served to supply some general deflclcncler: in the 
Imovledge necessary to use SIS effectively. 

I|« Attitudes towm'd topics related to workshop content and goals 

appear rather uniformly positive. Items in three catv^gorleC; SIC; 
Using Evaluative Data; and the Workshop; produced consictcnt moon 
scores. Participants generally agreed with favoro,>ilc statement c and 
disagreed with unfavorable statements. 



RECOMMENDATICKS 



Several recommendations follow logically from the conclusions. These 
relate to both p^orposes toward which evalmtlon of the program was addressed: 
identification of inservlce needs and assessment of acceptance and understanding. 

1. The general success of the program leads to the recommendation that 
additional training programs of this type be considered. Effective 
professional development depends on the nourishment of Inservlce 
training. Increasing the ab^llity of adjninlstrators and superviooro 
to use the resources they have available is an Important port of 
this training. The SIS training programs should therefore be viewed 
as prototypes for systematic efforts of this kind. 

2. Because there was no single cognitive cr affective area that 
appeared most inneed of inservlce attention; future SIS training 
among these same participants should focus on application to 
specific areas of educational decision making. Working with various 
subgroups of decision makers who now have the desire and taowleclge 
necessary to use SIS; it will be possible to become increasingly 
specific about its application. 

3. At the same time; the cognitive and attltudlnal galne achieved 
throxjgh the workshop must be preserved. This caii perhaps best be done 
by consistently enphasizing the service function of SIS. As faith 

in the system as a valuable means of improving the q,uallty of educational 
decisions is reinforced; administrators will come to use the dat«' 
more fregtuentl^r and more effectively. 
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PinolXy^ as SIS becomes institutionalized^ provision should be 
made to orient new azid aspiring administrators to the system* 
One means of achieving this would be to plan a seminar to be offered 
every two years. Essential content could correspond closely to 
that of the training; program. 



Prepared by: 

Joseph L. Felix 

Program Research & Design 

December 13^ 1972 



APPENDIX D 



Evaluation Instrument 



SUPERVISORS TRAINING 
3/23/73 



SESSION 



INTRODUCTION: Please respond to the following items pertaining to my prerentatlon 
today by checking the appropriate box which best describes how you 
feel. 



PRESENTER'S VOICE: 



Too Loud 
LJ About Right 
LZl Too Soft 



RATE OF TALKING: 



Q Too Fast 
□ About Right 
I I Too Slow 



ROLE PLAY SESSION: 



n Excellent 
n Good 
□ Poor 



MATERIALS: 



Q Excellent 
CH Good 
n Poor 



DID YOUR INSTRUCTOR (S) 



□ Motivate You 

□ Turn You Off 



DID YOUR INSTRUCTOR (S) : 



□ Give You Clear Direction 

□ Confuse You 

□ Do Nothing 



OVERALL ASSESSMENT OF THE SESSION: □ Good 

□ Fair 

□ Poor 



ANY OTHER GENERAL COMMENT(S): (Use reverse side if necessary) 



ERIC 



PLEASE RETURN TO BERNARD BARBADORA 
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APPENDIX E 



Evaluaticii Instrument 



ERIC 



School 

Information 
System 




CINCINNATI PUBLIC SCHOOLS 
Program fvesearch and Design 
230 East Ninth Street 
Ciacinnatl, Ohio 45202 



ESEA Title HI Project 



MEMOKANDU M 



DATE: April 16, 1973 

TO: Principal Addressed 

FROM: Arthur Tebbutt, Evaluator, School Information System 

RE: SIS Evaluation 

The School Information System is coming close to its end under 
ESEA Title III. The project staff is expected to report on how 
well objectives were accomplished. For this, you play a vital role. 

Since we have already received all the Title III money possible, 
there is no need to "snow"' anybody with this. So please be honest — 
and be assured that the results will be used purely for assessing 
the project. Your name is heeded only so I can bug non-returners. 
To repeat, you have my word that this is in no way an attempt to 
evaluate your responsiveness to the project. Results will be grouped 
and used to modify SIS in the future. 



AVT:bsm 



Enc. 
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PLii^'vSE Vail back m later TliiXN APIUL 23 to ^VJ^T TiilBBUTT, 3d L'L0^;R, liiDUCATION CENTER 



FEEDBACK FROM PRINCIPiVLS ON SIS 



The followin,'^ is designed, to take little of your time, but you^^ar^^^^encouraged 
to add whatever coiraiients might help to fully evaluate 31S. Please ^irclc^anriv/cr s. 

!• In (general, hov; well do you understand SIS reports? 

Very well Rather v;ell Rather little Very little 

Comment: [ . 

2. How often do you tend to use SIS reports? 
Daily Weekly Monthly Annually 

Comment: 

3. In terms of the following uses, hov; muc h do you refer to the reports? 



4. P 



to answer staff questions: • • ^ . » A lot 

to ^mswer parent questions: • • • • A lou 

for discussion in ijtaff meetings: • . A lot 

for discussion in community meetings: A lot 

to assess needs or develop goals 

for your school: A lot 

to evaluate aspects of your school: • A lot 



Somcv/haf. A little Not at all 

Jomcvjhat A little Not at all 

Somewhat A little Not at all 

Somewhat A little Not at all 

Somewhat A little Not at all 

Somewhat A little Not at all 



other 



A lot Somewhat A little Not at all 



ease rank each SIS report in terms of interest for you. 



^) 


Exceptional Characteristics • • 


• , None 


Low 


Medium 


High 


b) 


Variable Printout, 


• • None 


Low 


Medium 


High 


c) 


Factor Stanine • 


• None 


Low 


Medium 


High 


d) 


Variable Stanine • . • 


• . Nona 


Low 


Medium 


High 


e) 


Student Survey 


• • None 


Low 


Medium 


High 


f ) 


Teacher Sux'vey «... 


. . None 


Low 


I'ledium 


High 




Parent Survey e * . 


. . Hone 


Low 


He dium 


High 


h) 


Goal Survey. 


. . None 


Low 


Medium 


High 


i) 


Trend Report • * 


. . None 


Low 


Medium 


High 


3) 


Achievement Forecast 


. • Kone 


Low. 


Medium 


High 



VJliat vjould you like SIS to err^hasize next year? 

Shorter or fewer reports More training for users 

More help with data usage Other 



6. Finally, feel free to e::press in your own v7ords what you think of SIS. 
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APPENDIX F 



Report On Your School 
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AN INFORMATION REPORT PREPARED FOR 



COVEDALE SCHOOL 



Clifford Franklin, Principal 
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VVHAT DO STUDENTS, PARENTS, AND TEACHERS FEEL TH/ 



STUDENTS 



PERCENT RESPONDING 




Job Training 

Improvement of Basic Skills 
Understanding Other People 
Talent Development 



61^ 
56 

40- 



PARENTS 



Improven; 

(Tnaracter 
Seir-DiiV 





WHAT ARE STUDENTS LIKE IN YOUR SCHOOL? 



fOO 
90 
80 
70 
60 
50 
40 
30 
20 
10 
0 



SYSTEM WIDE 
- AVERAGE — 



58 



56 



70-71 



71-72 



STUDENT ATTITUDES 
TOWARD SCHOOL 



SYSTEM WIDE 
AVERAGE- 




70-71 



7i-72 



STUDENT ATTITUDES 
TOWARD THEMSELVES 



ON. . . 



'"'s 15 a repqrf on the public school in your area. If includes informarion about educational goals, 
cteristics, community characteristics, and student achievement. To show changes or possible trends, 
>vers two school years, 1970-71 and 1971-72. 

st of the information is shown in graphic form, ccn^paring your school with the average for all 
ubiic schools. Standardized test results, though, are compared to national averages. 



DOLS SHOULD EMPHASIZE? 



PERCENT RESPONDING 



TEACHERi; 



PERCENT RESPONDING 



•asic Skills 



rim 



76!^ 
52 
50 
49 



Improvement of Basic Skills 
Character. Building 
Self -Development 
Citizenship 



75% 
62 
58 
50 



SYSTEM WIDE 
AVERAGE — 



29 



SYSTEM WIDE 
- AVERAGE^ 



/A 



SYSTEM WIDE 
■ AVERAGt 



8 4 



70-71 



71-72 



CONFIDtislCE IN ABILITY 
ci rrcEED IN SCHOOL 
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70-71 



7) -72 



% OF STUDENTS TRANSFERRING 
IN OR out OF YOUR SCHOOL 



70-71 



71-72 



% OF STUDENTS ABSENT 
PER DAY AT YOUR SCHOOL 



^ 




WHAT IS YOUR SCHOOL COMMUNITY LIKE? 



SYSTEM v;iDE 
AVERAGE 



68 



70-71 



85 



71-72 



% OF PARENTS THAT FEEL THE 
SCHOOL HAS A QUALITY PROGRAM 



SYSTEM \... 
AVERAGE 



MAY '72 
ELECTION 
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HOW WELL ARE STUDENTS ACHIEVING !N YOUR SCHOOL? 



THIRD GRADE 
% ABOVE & BELOW NATIONAL AVERAGE 



^7 



S2 



46 



SJL 



46 



44 
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71-72 
APTITUDE 



71-72 
WORD 
KNOWLEDGE 



71-72 
READING 



71-72 
COMPUTATION 



71- 
PRC' 
SOL. 



/. '72 
TION 

WHO 



70-71 



71-72 



% OF CHILDREN FROM LOW INCOME 
FAMILIES 



HOW IS THE STAFF MORALE? 



SYSTEM '.VIDE 
AVERAGE 



Excellenr 7 

6 
5 

Average 4 
3 
2 

Poor 1 



4.3 



4.2 



70-71 



71-72 



SIXTH GRADE 
% ABOVE & BELOW NATIONAL AVERAGE 




70-71 71-72 70-71 71-72 70-71 71-72 70-71 71-72 70-71 71-7? 

APTITUDE WORD READING COMPUTATION PROBLEM 

KNOWLEDGE SOLVING 



A MESSAGE FROM THE SUPERINTENDENT 



The Cincinn^3ti Public Schools try to serve the educational needs of almost 
80,000 pupils. We attempt to accomplis'n our mission with the highest degree of 
quality that is possible with the resources available. Ultimately, It Is the citizens 
of Cincinnati who judge how well the school S'/^tem has done and, more important, 
where and how the system can improve services to school children. 

In order for you, the citizens of our community^ to make sound fudgments, 
you need basic information. REPORT ON YOUR SCHOOL is our attempt at giving 
you such Information; it is our report card to you. W(£ have selected Information 
we believe would be of greatest Interest to you. If you want additional information, 
the principal of your area school will be happy to respond to your needs. 

This release is one of two reports describing our schools. While this report 
focuses on an Individual school, the second will describe the entire school system. 
To be most effective, this report should be presented and discussed at local 
school-community meetings under the leadership of the school principal. At such 
meetings, citizens can have the opportunity to seek clarification of the information 
presented, ask for additional Information, and express their views on what they 
perceive as the primary goals toward which their school should be striving. 

The Cincinnati Public Schools are committed to a policy of citizens' having a 
right to know about their schools. The school system is also committed to a policy 
of seeking active Involvement of its citizens In the decisions which affect the 
education of their children. It is our hope that this report will lead to the accomp- 
lishment of both goals. I will appreciate your comments concerning this report. 
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